[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 417617306 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524588K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.002324] x2apic enabled [ 0.003005] Switched APIC routing to physical x2apic. [ 0.004008] kvm-guest: setup PV IPIs [ 0.007671] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008021] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009009] pid_max: default: 32768 minimum: 301 [ 0.011029] LSM: Security Framework initializing [ 0.012035] Yama: becoming mindful. [ 0.013026] SELinux: Initializing. [ 0.015015] *** VALIDATE selinux *** [ 0.023259] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.028432] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.029141] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030100] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031095] *** VALIDATE tmpfs *** [ 0.032442] *** VALIDATE proc *** [ 0.033215] *** VALIDATE cgroup *** [ 0.034006] *** VALIDATE cgroup2 *** [ 0.035258] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037073] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.038004] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039023] Spectre V2 : User space: Vulnerable [ 0.040006] Speculative Store Bypass: Vulnerable [ 0.043668] debug: unmapping init [mem 0xffffffffaba59000-0xffffffffaba60fff] [ 0.045157] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.046659] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047015] ... version: 2 [ 0.048009] ... bit width: 48 [ 0.049009] ... generic registers: 4 [ 0.050010] ... value mask: 0000ffffffffffff [ 0.051011] ... max period: 00007fffffffffff [ 0.052009] ... fixed-purpose events: 3 [ 0.053007] ... event mask: 000000070000000f [ 0.054235] rcu: Hierarchical SRCU implementation. [ 0.056268] smp: Bringing up secondary CPUs ... [ 0.057453] x86: Booting SMP configuration: [ 0.058015] .... node #0, CPUs: #1 #2 #3 [ 0.060522] smp: Brought up 1 node, 4 CPUs [ 0.062007] smpboot: Max logical packages: 1 [ 0.063006] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.144806] node 0 deferred pages initialised in 81ms [ 0.147007] devtmpfs: initialized [ 0.148045] x86/mm: Memory block size: 128MB [ 0.150104] gcov: version magic: 0x41383552 [ 0.152071] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.153048] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.154217] pinctrl core: initialized pinctrl subsystem [ 0.155091] [ 0.155349] ************************************************************* [ 0.156007] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.158006] ** ** [ 0.159004] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.160005] ** ** [ 0.162005] ** This means that this kernel is built to expose internal ** [ 0.163004] ** IOMMU data structures, which may compromise security on ** [ 0.164005] ** your system. ** [ 0.165005] ** ** [ 0.166006] ** If you see this message and you are not debugging the ** [ 0.168005] ** kernel, report this immediately to your vendor! ** [ 0.169004] ** ** [ 0.170005] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.171004] ************************************************************* [ 0.173465] NET: Registered protocol family 16 [ 0.174275] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.176036] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.177031] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.180010] cpuidle: using governor menu [ 0.180962] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.183410] PCI: Using configuration type 1 for base access [ 0.184107] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.191107] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.193015] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.195136] cryptd: max_cpu_qlen set to 1000 [ 0.197260] ACPI: Added _OSI(Module Device) [ 0.198009] ACPI: Added _OSI(Processor Device) [ 0.198906] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.200009] ACPI: Added _OSI(Processor Aggregator Device) [ 0.203508] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.208459] ACPI: Interpreter enabled [ 0.210045] ACPI: PM: (supports S0 S3 S4 S5) [ 0.211007] ACPI: Using IOAPIC for interrupt routing [ 0.212081] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.214369] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.222613] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.224021] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.226014] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.228110] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.232216] acpiphp: Slot [2] registered [ 0.233140] acpiphp: Slot [5] registered [ 0.234087] acpiphp: Slot [6] registered [ 0.235075] acpiphp: Slot [7] registered [ 0.237075] acpiphp: Slot [8] registered [ 0.238071] acpiphp: Slot [9] registered [ 0.239093] acpiphp: Slot [10] registered [ 0.240075] acpiphp: Slot [3] registered [ 0.242066] acpiphp: Slot [4] registered [ 0.243054] acpiphp: Slot [11] registered [ 0.244061] acpiphp: Slot [12] registered [ 0.245058] acpiphp: Slot [13] registered [ 0.246060] acpiphp: Slot [14] registered [ 0.247076] acpiphp: Slot [15] registered [ 0.248070] acpiphp: Slot [16] registered [ 0.249062] acpiphp: Slot [17] registered [ 0.250054] acpiphp: Slot [18] registered [ 0.251054] acpiphp: Slot [19] registered [ 0.253052] acpiphp: Slot [20] registered [ 0.254071] acpiphp: Slot [21] registered [ 0.255056] acpiphp: Slot [22] registered [ 0.256061] acpiphp: Slot [23] registered [ 0.257053] acpiphp: Slot [24] registered [ 0.258053] acpiphp: Slot [25] registered [ 0.259075] acpiphp: Slot [26] registered [ 0.260101] acpiphp: Slot [27] registered [ 0.261053] acpiphp: Slot [28] registered [ 0.263047] acpiphp: Slot [29] registered [ 0.264065] acpiphp: Slot [30] registered [ 0.266079] acpiphp: Slot [31] registered [ 0.267063] PCI host bridge to bus 0000:00 [ 0.269012] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.271012] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.273012] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.276009] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.277007] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.278009] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.279036] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.280572] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.282644] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.288924] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.291500] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.293010] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.294005] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.296007] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.297403] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.299467] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.300025] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.302483] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.305007] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.313011] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.317563] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.322163] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.326010] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.329009] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.346018] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.357534] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.363017] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.369011] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.384014] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.394881] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.398920] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.403009] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.422014] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.430385] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.432855] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.436957] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.448857] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.456808] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.461889] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.464750] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.477014] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.486320] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.491013] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.494917] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.509937] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.520236] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.522271] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.524265] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.527317] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.529136] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.532087] iommu: Default domain type: Passthrough [ 0.534377] SCSI subsystem initialized [ 0.536100] ACPI: bus type USB registered [ 0.537110] usbcore: registered new interface driver usbfs [ 0.539078] usbcore: registered new interface driver hub [ 0.541067] usbcore: registered new device driver usb [ 0.543142] pps_core: LinuxPPS API ver. 1 registered [ 0.545008] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.548042] PTP clock support registered [ 0.550112] EDAC MC: Ver: 3.0.0 [ 0.551295] PCI: Using ACPI for IRQ routing [ 0.552550] NetLabel: Initializing [ 0.553007] NetLabel: domain hash size = 128 [ 0.553909] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.556049] NetLabel: unlabeled traffic allowed by default [ 0.557116] vgaarb: loaded [ 0.558195] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.560007] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.564243] clocksource: Switched to clocksource kvm-clock [ 0.642186] VFS: Disk quotas dquot_6.6.0 [ 0.643616] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.645987] *** VALIDATE ramfs *** [ 0.647159] *** VALIDATE hugetlbfs *** [ 0.648720] pnp: PnP ACPI init [ 0.651536] pnp: PnP ACPI: found 6 devices [ 0.666108] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.669237] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.671238] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.673191] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.675325] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.677349] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.679796] NET: Registered protocol family 2 [ 0.682055] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.686351] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.689585] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.694389] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.697486] TCP: Hash tables configured (established 65536 bind 65536) [ 0.699935] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.702658] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.705150] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.707690] NET: Registered protocol family 1 [ 0.710135] RPC: Registered named UNIX socket transport module. [ 0.711969] RPC: Registered udp transport module. [ 0.713430] RPC: Registered tcp transport module. [ 0.714961] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.717138] NET: Registered protocol family 44 [ 0.718727] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.721098] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.723286] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.725707] PCI: CLS 0 bytes, default 64 [ 0.728582] Unpacking initramfs... [ 2.018263] debug: unmapping init [mem 0xffff8f9cfcc54000-0xffff8f9cfffbffff] [ 2.025195] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.027706] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.032043] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.522442] Initialise system trusted keyrings [ 2.523562] Key type blacklist registered [ 2.524847] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.530496] zbud: loaded [ 2.532535] *** VALIDATE nfs *** [ 2.533267] *** VALIDATE nfs4 *** [ 2.534335] pstore: using deflate compression [ 2.536700] Platform Keyring initialized [ 2.632701] NET: Registered protocol family 38 [ 2.634263] Key type asymmetric registered [ 2.635774] Asymmetric key parser 'x509' registered [ 2.637676] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.641230] io scheduler mq-deadline registered [ 2.643339] io scheduler kyber registered [ 2.645579] io scheduler bfq registered [ 2.647584] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.651272] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.654389] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.657846] ACPI: Power Button [PWRF] [ 2.662683] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.670159] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.685883] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 2.698317] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 2.718248] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.744433] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.772745] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.777623] Non-volatile memory driver v1.3 [ 2.779594] Linux agpgart interface v0.103 [ 2.817301] virtio_blk virtio1: [vda] 145848 512-byte logical blocks (74.7 MB/71.2 MiB) [ 2.820294] vda: detected capacity change from 0 to 74674176 [ 2.836679] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.840430] vdb: detected capacity change from 0 to 1073741824 [ 2.855815] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.858611] vdc: detected capacity change from 0 to 2621440000 [ 2.873503] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.876101] vdd: detected capacity change from 0 to 2621440000 [ 2.891927] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 2.894454] vde: detected capacity change from 0 to 4294967296 [ 2.908617] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 2.912844] vdf: detected capacity change from 0 to 4294967296 [ 2.919532] libphy: Fixed MDIO Bus: probed [ 2.925351] usbcore: registered new interface driver usbserial_generic [ 2.928453] usbserial: USB Serial support registered for generic [ 2.931310] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.935130] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.936743] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.938713] mousedev: PS/2 mouse device common for all mice [ 2.942349] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.943407] rtc_cmos 00:05: RTC can wake from S4 [ 2.948460] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 2.949524] rtc_cmos 00:05: registered as rtc0 [ 2.953355] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.955855] intel_pstate: CPU model not supported [ 2.955992] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 2.961917] hid: raw HID events driver (C) Jiri Kosina [ 2.963771] usbcore: registered new interface driver usbhid [ 2.965591] usbhid: USB HID core driver [ 2.967025] drop_monitor: Initializing network drop monitor service [ 2.969094] Initializing XFRM netlink socket [ 2.970674] NET: Registered protocol family 10 [ 2.973060] Segment Routing with IPv6 [ 2.974153] NET: Registered protocol family 17 [ 2.976962] mpls_gso: MPLS GSO support [ 2.984901] RAS: Correctable Errors collector initialized. [ 2.986733] AVX version of gcm_enc/dec engaged. [ 2.987988] AES CTR mode by8 optimization enabled [ 3.066519] sched_clock: Marking stable (3066439467, 0)->(3830986941, -764547474) [ 3.077729] registered taskstats version 1 [ 3.080566] Loading compiled-in X.509 certificates [ 3.082668] zswap: loaded using pool lzo/zbud [ 3.108168] Key type big_key registered [ 3.119514] Key type encrypted registered [ 3.121218] ima: No TPM chip found, activating TPM-bypass! [ 3.123437] ima: Allocated hash algorithm: sha1 [ 3.125154] ima: No architecture policies found [ 3.126680] evm: Initialising EVM extended attributes: [ 3.128225] evm: security.selinux [ 3.129553] evm: security.ima [ 3.130580] evm: security.capability [ 3.131742] evm: HMAC attrs: 0x1 [ 3.133806] rtc_cmos 00:05: setting system clock to 2026-09-02 12:44:42 UTC (1788353082) [ 3.139534] debug: unmapping init [mem 0xffffffffaca03000-0xffffffffacbfffff] [ 3.142489] debug: unmapping init [mem 0xffffffffab782000-0xffffffffaba58fff] [ 3.149072] Write protecting the kernel read-only data: 28672k [ 3.152966] debug: unmapping init [mem 0xffffffffa9e03000-0xffffffffa9ffffff] [ 3.155611] debug: unmapping init [mem 0xffffffffaa714000-0xffffffffaa7fffff] [ 3.184581] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.193853] systemd[1]: Detected virtualization kvm. [ 3.195908] systemd[1]: Detected architecture x86-64. [ 3.198453] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.223673] systemd[1]: No hostname configured. [ 3.226896] systemd[1]: Set hostname to . [ 3.229437] random: systemd: uninitialized urandom read (16 bytes read) [ 3.232067] systemd[1]: Initializing machine ID from random generator. [ 3.393819] random: systemd: uninitialized urandom read (16 bytes read) [ 3.397238] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 3.403315] random: systemd: uninitialized urandom read (16 bytes read) [ 3.405336] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 3.409599] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Listening on Journal Socket. Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ OK ] Reached target Sockets. Starting Apply Kernel Variables... Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Initrd Root Device. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.148898] device-mapper: uevent: version 1.0.3 [ 4.150984] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 5.050194] virtio_net virtio0 ens2: renamed from eth0 [ 5.090545] random: fast init done [ 5.313496] scsi host0: ata_piix [ 5.375544] scsi host1: ata_piix [ 5.376988] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.382748] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.657892] random: crng init done [ 9.666837] random: 7 urandom warning(s) missed due to ratelimiting [ 9.732308] dracut-initqueue[584]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 11.334960] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 13.190687] printk: systemd: 26 output lines suppressed due to ratelimiting [ 13.695597] SELinux: Disabled at runtime. [ 13.773088] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 13.783786] systemd[1]: Detected virtualization kvm. [ 13.785785] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 15.102244] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.112105] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 15.124569] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 15.133314] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 15.136657] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 15.148227] systemd[1]: Starting Journal Service... Starting Journal Service... [ 15.158975] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... Starting Remount Root and Kernel File Systems... Mounting POSIX Message Queue File System... [ OK ] Listening on Process Core Dump Socket. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Kernel Debug File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting Apply Kernel Variables... [ OK ] Listening on initctl Compatibility Named Pipe. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ 15.431771] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Stopped target Initrd Root File System. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 16.017263] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 16.773145] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 16.917669] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 17.155504] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 17.190047] EDAC sbridge: Ver: 1.1.2 [ 20.662941] Key type dns_resolver registered [ 21.281575] NFS: Registering the id_resolver key type [ 21.285794] Key type id_resolver registered [ 21.288483] Key type id_legacy registered [* ] A start job is running for Configur…-only root support (6s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Network Manager Wait Online... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... Starting Hostname Service... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg322-server login: [ 50.017749] libcfs: loading out-of-tree module taints kernel. [ 50.043644] Key type ._llcrypt registered [ 50.045332] Key type .llcrypt registered [ 50.096764] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 57.993206] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 58.662904] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 58.671259] alg: No test for adler32 (adler32-zlib) [ 59.691914] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 60.068879] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 61.736117] Key type lgssc registered [ 62.327337] Lustre: Echo OBD driver; http://www.lustre.org/ [ 68.564528] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 82.459779] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 87.123314] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 87.134816] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 88.223141] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 88.236485] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 88.276377] Lustre: lustre-MDT0000: new disk, initializing [ 88.303433] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 88.311075] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 89.688332] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 94.852575] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 94.892412] Lustre: 6484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 94.905575] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 94.908417] Lustre: Skipped 1 previous similar message [ 94.947897] Lustre: lustre-MDT0001: new disk, initializing [ 94.970785] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 94.979331] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 94.984211] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 96.279707] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 98.530100] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 101.661094] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 101.753323] Lustre: lustre-OST0000: new disk, initializing [ 101.754794] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 101.757316] Lustre: 8422:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 101.776235] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 103.682440] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 105.963080] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 105.966515] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 105.978623] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 109.009042] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 109.050896] Lustre: lustre-OST0001: new disk, initializing [ 109.052606] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 109.055187] Lustre: 9495:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 109.073786] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 110.923433] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 111.722440] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 111.725035] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 111.734216] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 116.597127] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 122.089988] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 123.947178] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing check_logdir /tmp/testlogs/ [ 125.428419] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing yml_node [ 126.922748] Lustre: DEBUG MARKER: Client: 2.17.55.23 [ 127.803864] Lustre: DEBUG MARKER: MDS: 2.17.55.23 [ 128.643318] Lustre: DEBUG MARKER: OSS: 2.17.55.23 [ 129.217074] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Wed Sep 2 08:46:47 EDT 2026 [ 135.119257] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 135.664211] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 147.936867] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 147.937205] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 147.941507] Lustre: Skipped 2 previous similar messages [ 147.943762] Lustre: Skipped 1 previous similar message [ 153.057039] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 153.061554] Lustre: Skipped 3 previous similar messages [ 153.499747] Lustre: server umount lustre-MDT0000 complete [ 154.791846] LustreError: 9494:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353234 with bad export cookie 7013325426317797590 [ 154.793435] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 154.795651] LustreError: 9494:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 158.176830] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 158.177123] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 158.181551] Lustre: Skipped 2 previous similar messages [ 160.926690] Lustre: server umount lustre-MDT0001 complete [ 168.318511] Lustre: server umount lustre-OST0000 complete [ 175.696674] Lustre: server umount lustre-OST0001 complete [ 177.814726] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 181.190309] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 194.131994] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 194.222329] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 194.235938] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 194.274330] Lustre: lustre-MDT0000: new disk, initializing [ 194.299857] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 194.307782] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 195.750272] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 200.100063] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 200.150339] Lustre: 15033:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 200.258177] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 201.696904] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 205.653902] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 207.615413] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 209.970377] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 210.079986] Lustre: lustre-OST0000: new disk, initializing [ 210.081455] Lustre: Skipped 1 previous similar message [ 210.083284] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 210.086241] Lustre: Skipped 2 previous similar messages [ 210.089484] Lustre: 17001:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 210.125630] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 210.128906] Lustre: Skipped 1 previous similar message [ 211.645094] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 211.648412] Lustre: Skipped 1 previous similar message [ 211.649988] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 211.694498] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 212.123670] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 216.124591] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 217.645181] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 217.721323] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 219.180951] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 219.264742] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 222.180692] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 222.181605] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 222.182311] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 222.182315] Lustre: Skipped 3 previous similar messages [ 222.186494] Lustre: Skipped 1 previous similar message [ 222.190629] LustreError: Skipped 1 previous similar message [ 226.072615] Lustre: server umount lustre-OST0000 complete [ 230.880873] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 230.883959] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 230.888359] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 230.890702] Lustre: Skipped 1 previous similar message [ 233.512308] Lustre: server umount lustre-MDT0000 complete [ 234.735306] LustreError: 17000:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353314 with bad export cookie 7013325426317799123 [ 234.738247] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 234.739089] LustreError: 17000:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 234.850494] Lustre: server umount lustre-MDT0001 complete [ 236.505604] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 08:48:34 (1788353314) [ 238.790875] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 238.936874] LustreError: 19261:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 238.942909] LustreError: 19261:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 238.958525] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 240.296421] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 243.203403] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 244.631015] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 247.042031] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 248.886350] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 251.224258] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 253.623881] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 256.266475] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 268.950142] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 274.400955] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 274.403783] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 274.408190] Lustre: Skipped 1 previous similar message [ 274.410640] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 274.412930] Lustre: Skipped 2 previous similar messages [ 278.170263] Lustre: server umount lustre-MDT0000 complete [ 279.607328] LustreError: 19241:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353358 with bad export cookie 7013325426317800005 [ 279.611053] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 279.612642] LustreError: 19241:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 279.735137] Lustre: server umount lustre-MDT0001 complete [ 291.489429] Lustre: server umount lustre-OST0000 complete [ 299.781621] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 304.148843] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 304.354804] LustreError: 23658:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 304.371425] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 304.375229] Lustre: Skipped 2 previous similar messages [ 306.079313] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 309.729733] LustreError: 23659:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 309.796024] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 311.760544] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 313.074822] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 315.768086] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 318.083872] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 321.456054] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 321.530510] Lustre: lustre-OST0001: new disk, initializing [ 321.533705] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 321.538416] Lustre: 25972:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 323.272555] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 323.276077] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 323.316533] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 323.647731] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 328.316311] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 329.556424] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 334.819151] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 334.820624] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 334.825144] Lustre: Skipped 5 previous similar messages [ 334.827659] Lustre: Skipped 4 previous similar messages [ 334.987863] LustreError: 27138:0:(ldlm_resource.c:1207:ldlm_resource_complain()) MGS: namespace resource [0x736d61726170:0x3:0x0].0x0 (ffff8f9d42b62200) refcount nonzero (2) after lock cleanup; forcing cleanup. [ 335.016334] Lustre: server umount lustre-MDT0000 complete [ 336.415118] LustreError: 23640:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353415 with bad export cookie 7013325426317800852 [ 336.418093] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 336.420794] LustreError: 23640:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 338.551200] Lustre: server umount lustre-MDT0001 complete [ 350.284577] Lustre: server umount lustre-OST0000 complete [ 360.800723] Lustre: server umount lustre-OST0001 complete [ 366.208715] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 369.584440] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 369.710730] LustreError: 28934:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 369.726140] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 369.728546] Lustre: Skipped 3 previous similar messages [ 371.045113] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 373.783288] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 375.156976] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 376.056680] Lustre: 30081:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 378.103387] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 380.151064] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 380.259889] LustreError: 30434:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 382.807541] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 384.774981] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 387.832114] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 388.964866] Lustre: 31959:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 394.215162] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 394.216404] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 394.218034] Lustre: Skipped 2 previous similar messages [ 394.219665] Lustre: Skipped 2 previous similar messages [ 396.629739] Lustre: server umount lustre-MDT0000 complete [ 397.781176] LustreError: 29684:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353477 with bad export cookie 7013325426317802084 [ 397.783353] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 397.784565] LustreError: 29684:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 397.892827] Lustre: server umount lustre-MDT0001 complete [ 409.540955] Lustre: server umount lustre-OST0000 complete [ 421.014892] Lustre: server umount lustre-OST0001 complete [ 423.771128] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 08:51:41 (1788353501) [ 432.418149] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 435.525253] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 435.639915] LustreError: 34754:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 436.916848] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 439.590100] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 440.990327] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 442.016529] Lustre: 35903:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 444.273041] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 446.304094] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 448.939123] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 450.863935] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 453.890119] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 455.056910] Lustre: 37778:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 460.260607] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 460.261391] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 460.262174] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 460.262179] Lustre: Skipped 2 previous similar messages [ 460.269949] Lustre: Skipped 4 previous similar messages [ 462.423138] Lustre: server umount lustre-MDT0000 complete [ 463.597245] LustreError: 37780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353542 with bad export cookie 7013325426317803176 [ 463.601333] LustreError: 37780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 463.601919] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 463.706685] Lustre: server umount lustre-MDT0001 complete [ 475.587285] Lustre: server umount lustre-OST0000 complete [ 487.070082] Lustre: server umount lustre-OST0001 complete [ 490.010857] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 08:52:48 (1788353568) [ 495.133204] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 498.509735] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 498.636401] LustreError: 39914:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 498.642857] LustreError: 39914:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 498.653684] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 498.655817] Lustre: Skipped 7 previous similar messages [ 499.985544] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 502.933383] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 504.443138] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 505.425828] Lustre: 41064:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 507.647716] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 509.814396] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 512.693579] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 514.713249] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 517.981315] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 519.589455] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 519.591801] Lustre: Skipped 1 previous similar message [ 523.744994] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 524.261253] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 524.266966] Lustre: Skipped 3 previous similar messages [ 526.749328] Lustre: server umount lustre-MDT0000 complete [ 528.153447] LustreError: 39895:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353607 with bad export cookie 7013325426317804261 [ 528.157083] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 528.158855] LustreError: 39895:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 531.196385] LustreError: 39911:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.22@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 531.203848] LustreError: 39911:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 534.320620] Lustre: server umount lustre-MDT0001 complete [ 537.351023] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 538.400116] LustreError: 43797:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 538.404340] LustreError: 43797:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8f9d74d48e00 x1875224181363712/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788353617 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 [ 538.412905] LustreError: 43797:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 538.528560] LustreError: 3621:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8f9c43985c00 x1875224181365120/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 540.161434] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 543.255792] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 544.802195] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 547.130956] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 558.054713] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 562.115876] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 14 sec [ 563.176081] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 563.177892] Lustre: Skipped 1 previous similar message [ 563.934582] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 564.474731] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 571.859840] Lustre: server umount lustre-MDT0000 complete [ 573.089739] LustreError: 42941:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353652 with bad export cookie 7013325426317805339 [ 573.094528] LustreError: 42941:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 573.095266] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 573.211802] Lustre: server umount lustre-MDT0001 complete [ 583.687095] Lustre: server umount lustre-OST0000 complete [ 595.223186] Lustre: server umount lustre-OST0001 complete [ 598.038075] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 08:54:36 (1788353676) [ 603.409938] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 606.839046] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 606.957299] LustreError: 47557:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 606.965199] LustreError: 47557:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 608.250626] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 610.813897] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 612.178981] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 613.116811] Lustre: 48708:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 613.121070] Lustre: 48708:0:(mgs_llog.c:1450:mgs_modify_param()) Skipped 1 previous similar message [ 615.215665] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 617.114701] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 619.970674] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 621.909700] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 624.937615] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 626.323969] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 631.269101] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 631.270458] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 631.274308] Lustre: Skipped 22 previous similar messages [ 635.732478] Lustre: server umount lustre-MDT0000 complete [ 636.992410] Lustre: server umount lustre-MDT0001 complete [ 647.684375] Lustre: server umount lustre-OST0000 complete [ 659.108334] Lustre: server umount lustre-OST0001 complete [ 662.414374] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 08:55:40 (1788353740) [ 663.250301] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 663.874170] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 08:55:41 (1788353741) [ 667.222718] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 670.188039] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 677.643298] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 677.726648] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 677.760555] Lustre: lustre-MDT0000: new disk, initializing [ 677.785078] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 679.104475] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 682.793614] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 685.009508] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 685.101813] Lustre: 54776:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 686.334394] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 686.342298] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 687.018896] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 690.680609] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 691.335528] Lustre: DEBUG MARKER: create test files [ 701.923202] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 701.923290] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 701.929528] Lustre: Skipped 10 previous similar messages [ 706.124851] Lustre: server umount lustre-OST0000 complete [ 707.502934] Lustre: server umount lustre-MDT0000 complete [ 710.865792] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 711.829467] Key type lgssc unregistered [ 711.945572] LNet: 56381:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 711.947420] LNetError: 56381:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 711.955337] LNet: Removed LNI 192.168.203.122@tcp [ 712.307113] Key type .llcrypt unregistered [ 712.308340] Key type ._llcrypt unregistered [ 722.069857] Key type ._llcrypt registered [ 722.070939] Key type .llcrypt registered [ 722.107879] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 722.503899] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 722.557857] alg: No test for adler32 (adler32-zlib) [ 723.416682] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 723.510080] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 725.096116] Key type lgssc registered [ 725.474396] Lustre: Echo OBD driver; http://www.lustre.org/ [ 727.841353] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 727.849293] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 728.979742] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 730.241711] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 732.459505] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 734.601277] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 734.714141] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 736.462907] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 738.780280] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 738.788684] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:88 to 0x240000400:129) [ 738.816745] Lustre: 59087:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 738.819570] Lustre: 59087:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 738.821423] Lustre: 59087:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 738.823231] Lustre: 59087:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 738.825108] Lustre: 59087:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 738.827067] Lustre: 59087:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 741.722353] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 743.106275] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 749.026806] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 749.027366] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 749.035340] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 751.052752] Lustre: server umount lustre-OST0000 complete [ 752.362503] Lustre: server umount lustre-MDT0000 complete [ 755.972351] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 756.904493] Key type lgssc unregistered [ 757.023328] LNet: 60696:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 757.025670] LNetError: 60696:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 757.034288] LNet: Removed LNI 192.168.203.122@tcp [ 757.319068] Key type .llcrypt unregistered [ 757.320583] Key type ._llcrypt unregistered [ 767.688964] Key type ._llcrypt registered [ 767.689917] Key type .llcrypt registered [ 767.723580] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 768.084466] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 768.090937] alg: No test for adler32 (adler32-zlib) [ 768.929624] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 769.015534] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 770.592134] Key type lgssc registered [ 770.898846] Lustre: Echo OBD driver; http://www.lustre.org/ [ 773.340727] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 773.347540] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 774.489476] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 775.746852] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 777.975557] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 780.046962] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 780.143371] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 781.900935] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 784.231320] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 784.253359] Lustre: 63505:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 784.256572] Lustre: 63505:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 784.259394] Lustre: 63505:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 784.261891] Lustre: 63505:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 784.264846] Lustre: 63505:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 784.267392] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 784.267791] Lustre: 63505:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 787.232531] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 789.473900] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 789.473966] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 789.481434] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 794.593294] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 795.402451] Lustre: server umount lustre-OST0000 complete [ 796.681959] Lustre: server umount lustre-MDT0000 complete [ 799.988977] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 801.025595] Key type lgssc unregistered [ 801.147326] LNet: 65060:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 801.149826] LNetError: 65060:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 801.158277] LNet: Removed LNI 192.168.203.122@tcp [ 801.427032] Key type .llcrypt unregistered [ 801.428062] Key type ._llcrypt unregistered [ 806.815103] Key type ._llcrypt registered [ 806.816721] Key type .llcrypt registered [ 806.852527] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 812.894017] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 813.194468] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 813.212798] alg: No test for adler32 (adler32-zlib) [ 814.060305] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 814.140915] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 815.712124] Key type lgssc registered [ 816.031124] Lustre: Echo OBD driver; http://www.lustre.org/ [ 826.684262] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 826.690973] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 827.767894] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 827.776628] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 827.810744] Lustre: lustre-MDT0000: new disk, initializing [ 827.831402] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 827.838909] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 829.202170] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 833.296406] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 833.342219] Lustre: 68184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 833.364119] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 833.365935] Lustre: Skipped 1 previous similar message [ 833.399238] Lustre: lustre-MDT0001: new disk, initializing [ 833.431049] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 833.445690] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 833.448672] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 834.723642] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 838.255692] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 839.942702] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 842.088572] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 842.185909] Lustre: lustre-OST0000: new disk, initializing [ 842.189211] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 842.192961] Lustre: 70149:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 842.224882] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 844.044549] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 847.603645] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 847.861751] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 847.865777] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 847.894725] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 848.898658] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 848.961394] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 850.200979] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 850.266809] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 852.964277] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 852.964450] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 852.965242] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 852.968170] Lustre: Skipped 1 previous similar message [ 852.970955] LustreError: Skipped 1 previous similar message [ 856.971656] Lustre: server umount lustre-OST0000 complete [ 859.104852] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 859.107487] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 859.111626] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 859.113499] Lustre: Skipped 1 previous similar message [ 863.200891] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 863.201452] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 864.286294] Lustre: server umount lustre-MDT0000 complete [ 865.477164] LustreError: 68177:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788353944 with bad export cookie 17465885289416513385 [ 865.479930] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 865.481078] LustreError: 68177:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 865.586647] Lustre: server umount lustre-MDT0001 complete [ 868.373689] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 08:59:06 (1788353946) [ 871.872024] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 884.017903] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 886.956965] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 898.275366] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 898.355494] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 898.366342] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 898.402050] Lustre: lustre-MDT0000: new disk, initializing [ 898.424338] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 898.432077] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 899.748726] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 903.843269] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 903.887856] Lustre: 76153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 903.917062] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 903.919761] Lustre: Skipped 1 previous similar message [ 903.957846] Lustre: lustre-MDT0001: new disk, initializing [ 903.990584] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 904.004841] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 904.008582] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 905.345776] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 909.087593] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 911.042341] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 913.319143] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 913.412688] Lustre: lustre-OST0000: new disk, initializing [ 913.414393] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 913.417285] Lustre: 78125:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 913.443250] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 915.319454] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 918.519337] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 918.522513] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 918.551518] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 918.882021] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 920.175819] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 920.252950] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 921.512017] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 921.575577] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 923.618666] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 923.618759] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 923.621436] LustreError: Skipped 1 previous similar message [ 923.625679] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 923.628924] Lustre: Skipped 2 previous similar messages [ 924.238719] Lustre: server umount lustre-OST0000 complete [ 928.737905] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 928.738430] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 928.742051] Lustre: Skipped 2 previous similar messages [ 931.547785] Lustre: server umount lustre-MDT0000 complete [ 932.793338] LustreError: 76148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354012 with bad export cookie 17465885289416514253 [ 932.795885] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 932.797278] LustreError: 76148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 932.911429] Lustre: server umount lustre-MDT0001 complete [ 935.651610] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 09:00:13 (1788354013) [ 937.830361] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 937.998260] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 939.349243] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 942.202567] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 943.581572] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 945.849441] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 947.574251] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 949.686844] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 951.616956] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 953.857996] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 955.015390] Lustre: 83200:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 2dc6089e-8ca8-49b1-8f3b-708e944e4c24 at adminstrative request [ 956.898566] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 956.903237] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 967.140615] Lustre: MGS: Client 2dc6089e-8ca8-49b1-8f3b-708e944e4c24 (at 0@lo) reconnecting [ 967.144126] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xf2634a21eb645e31 to 0xf2634a21eb6460bc [ 967.148706] Lustre: MGC192.168.203.122@tcp: Connection restored to 0@lo (at 0@lo) [ 987.398329] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 987.467472] Lustre: lustre-OST0001: new disk, initializing [ 987.468940] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 987.471291] Lustre: 83608:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 987.502725] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 987.506071] Lustre: Skipped 2 previous similar messages [ 989.301304] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 992.805494] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 993.690823] Lustre: server umount lustre-OST0001 complete [ 994.809705] LustreError: 82746:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 994.814941] LustreError: 82746:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 997.856754] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 997.859240] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 997.864484] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 997.866831] Lustre: Skipped 1 previous similar message [ 999.907618] LustreError: 82351:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 999.912730] LustreError: 82351:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 1005.026730] LustreError: 82746:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1005.031804] LustreError: 82746:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1009.120108] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1009.167964] Lustre: server umount lustre-OST0000 complete [ 1014.240831] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1014.243595] LustreError: Skipped 1 previous similar message [ 1014.244631] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1014.247832] Lustre: Skipped 1 previous similar message [ 1014.249744] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1014.252462] Lustre: Skipped 4 previous similar messages [ 1016.471807] Lustre: server umount lustre-MDT0000 complete [ 1017.627165] LustreError: 81267:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354096 with bad export cookie 17465885289416515772 [ 1017.629760] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1017.631678] LustreError: 81267:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1017.749961] Lustre: server umount lustre-MDT0001 complete [ 1020.464814] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 09:01:38 (1788354098) [ 1020.954493] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1021.512489] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 09:01:39 (1788354099) [ 1022.055950] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1022.634664] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 09:01:40 (1788354100) [ 1023.193126] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1023.735492] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 09:01:41 (1788354101) [ 1024.228657] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1024.770752] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 09:01:42 (1788354102) [ 1025.266694] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1027.170566] loop: module loaded [ 1027.174041] loop0: detected capacity change from 0 to 4294967296 [ 1027.183242] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1027.643725] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1028.595307] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1029.899481] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1038.166849] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1038.180396] LustreError: 87726:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1038.183099] LustreError: 87726:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1038.185884] LustreError: 87726:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1038.188822] LustreError: 87726:0:(super25.c:178:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1044.243609] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 1047.263613] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1058.709990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1058.789309] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1058.800282] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1058.836641] Lustre: lustre-MDT0000: new disk, initializing [ 1058.857897] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1058.864295] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1060.104868] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1064.146078] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1064.186876] Lustre: 90586:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1064.282118] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1065.551473] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1069.156584] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1071.011938] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1073.142974] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1073.252171] Lustre: 92554:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1075.137742] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1078.608202] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1079.799272] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1079.831105] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1079.895642] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1079.956673] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1081.226657] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1081.297373] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1084.899666] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1084.902884] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1084.904364] Lustre: Skipped 1 previous similar message [ 1084.907338] LustreError: Skipped 1 previous similar message [ 1084.909248] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1084.911899] Lustre: Skipped 3 previous similar messages [ 1088.083664] Lustre: server umount lustre-OST0000 complete [ 1095.448441] Lustre: server umount lustre-MDT0000 complete [ 1096.643108] LustreError: 91380:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354176 with bad export cookie 17465885289416516381 [ 1096.645681] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1096.646828] LustreError: 91380:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1096.755763] Lustre: server umount lustre-MDT0001 complete [ 1099.419893] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 09:02:57 (1788354177) [ 1101.536585] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1101.669829] LustreError: 94960:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1102.928445] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1105.667888] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1107.161214] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1109.519669] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1111.298152] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1113.481852] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1115.384580] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1117.694661] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1119.124953] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1127.348027] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 8 sec [ 1128.682334] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1128.750758] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1131.002092] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1131.060489] Lustre: lustre-OST0001: new disk, initializing [ 1131.063026] Lustre: Skipped 2 previous similar messages [ 1131.065492] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1131.068041] Lustre: Skipped 3 previous similar messages [ 1131.070418] Lustre: 98383:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1132.929839] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1136.694062] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1138.055328] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1139.711839] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1139.714977] Lustre: Skipped 2 previous similar messages [ 1139.716726] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1139.737363] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1140.152100] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 1141.436230] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1141.502760] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1151.643441] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1156.733756] Lustre: Failing over lustre-MDT0000 [ 1157.090126] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1157.092274] LustreError: Skipped 1 previous similar message [ 1157.094109] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1157.098103] Lustre: Skipped 3 previous similar messages [ 1157.099789] LustreError: 94961:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1157.110116] Lustre: server umount lustre-MDT0000 complete [ 1165.282594] LustreError: 94957:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1165.286800] LustreError: 94957:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 11 previous similar messages [ 1171.633511] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1171.635165] LDISKFS-fs (dm-0): recovery complete [ 1171.637549] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1171.673576] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1171.778171] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1172.919385] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1173.752451] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1173.753121] Lustre: 94957:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1177.058259] Lustre: 94961:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1177.062357] Lustre: 94961:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 1 previous similar message [ 1177.067777] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1177.086181] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1177.400088] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1177.714247] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1177.717265] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 1178.032106] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1178.034242] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 1178.354304] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1178.358669] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 8 previous similar messages [ 1178.985973] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1178.989032] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 1179.304106] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1179.306996] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 1180.568910] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1180.572171] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 6 previous similar messages [ 1181.200914] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1181.203947] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 1181.520094] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1181.523060] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 1184.650510] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1184.654159] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 12 previous similar messages [ 1185.282352] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1185.285661] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 1185.600175] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1185.602585] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 1192.786116] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1192.789155] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 25 previous similar messages [ 1193.418207] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1193.422417] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 1193.736103] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1193.738492] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 1209.033799] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1209.037693] Lustre: 101216:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 51 previous similar messages [ 1209.665857] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1209.668136] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 1209.984050] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1209.985967] LustreError: 101216:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 1233.080156] Lustre: 101216:0:(ldlm_lib.c:2393:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1233.085605] Lustre: 101216:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1233.090782] Lustre: 101216:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client d9115204-56c9-4c45-8522-1c29eabc1ec2@192.168.203.22@tcp [ 1233.098232] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1233.102152] Lustre: 101216:0:(ldlm_lib.c:1913:abort_req_replay_queue()) @@@ aborted: req@000000002c51689a x1875224964433536/t0(8589934776) o35->d9115204-56c9-4c45-8522-1c29eabc1ec2@192.168.203.22@tcp:168/0 lens 392/0 e 0 to 0 dl 1788354323 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1233.116955] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1233.121279] Lustre: lustre-MDT0000: Denying connection for new client d9115204-56c9-4c45-8522-1c29eabc1ec2 (at 192.168.203.22@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1233.127289] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1233.143204] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1233.143452] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1233.146507] Lustre: Skipped 2 previous similar messages [ 1233.169225] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 1233.169252] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 1239.521029] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1239.525508] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1239.527119] Lustre: Skipped 4 previous similar messages [ 1245.246499] Lustre: server umount lustre-OST0000 complete [ 1248.738670] LustreError: 97734:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1248.744064] LustreError: 97734:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [ 1252.499118] Lustre: server umount lustre-OST0001 complete [ 1259.803634] Lustre: server umount lustre-MDT0000 complete [ 1260.908179] LustreError: 94985:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354340 with bad export cookie 17465885289416567579 [ 1260.910802] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1260.913336] LustreError: 94985:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1261.014477] Lustre: server umount lustre-MDT0001 complete [ 1263.601724] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 09:05:41 (1788354341) [ 1265.972090] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1265.975069] Lustre: *** cfs_fail_loc=197, val=0*** [ 1281.440500] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1286.560374] LustreError: 103187:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.122@tcp: failed processing log, type 4: rc = -110 [ 1291.687930] Lustre: *** cfs_fail_loc=197, val=0*** [ 1291.689620] Lustre: Skipped 65 previous similar messages [ 1312.160369] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1312.162964] Lustre: Skipped 7 previous similar messages [ 1314.055790] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1316.371923] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1317.076217] Lustre: server umount lustre-OST0000 complete [ 1319.732595] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 09:06:37 (1788354397) [ 1333.098876] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1333.230592] LustreError: 104805:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1334.522108] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1338.058650] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1339.994486] LustreError: 104838:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1339.997834] LustreError: 104838:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1340.000545] LustreError: 104838:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -5 [ 1340.131781] Lustre: server umount lustre-MDT0000 complete [ 1349.940660] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 1352.818492] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1363.533791] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1363.619745] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1363.632951] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1363.670208] Lustre: lustre-MDT0000: new disk, initializing [ 1363.696604] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1365.090699] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1369.198941] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1369.245790] Lustre: 109003:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1369.346571] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1370.753066] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1374.607751] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1376.490136] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1378.619981] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1378.713196] Lustre: 110970:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1380.568433] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1384.114423] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1385.491961] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1385.502024] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1385.560550] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1386.830686] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1386.903095] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1390.563428] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1390.565657] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1390.566745] LustreError: Skipped 3 previous similar messages [ 1390.571616] Lustre: Skipped 9 previous similar messages [ 1390.574526] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1390.577921] Lustre: Skipped 10 previous similar messages [ 1393.615767] Lustre: server umount lustre-OST0000 complete [ 1400.983494] Lustre: server umount lustre-MDT0000 complete [ 1402.165210] LustreError: 110969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354481 with bad export cookie 17465885289416578226 [ 1402.168106] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1402.170443] LustreError: 110969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1402.284287] Lustre: server umount lustre-MDT0001 complete [ 1404.991211] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 09:08:03 (1788354483) [ 1407.847366] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 1408.845775] Key type lgssc unregistered [ 1408.965327] LNet: 113451:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1408.968189] LNetError: 113451:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1408.976317] LNet: Removed LNI 192.168.203.122@tcp [ 1409.290530] Key type .llcrypt unregistered [ 1409.292316] Key type ._llcrypt unregistered [ 1414.934236] Key type ._llcrypt registered [ 1414.935867] Key type .llcrypt registered [ 1414.972244] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 1420.866154] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1421.171173] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1421.199853] alg: No test for adler32 (adler32-zlib) [ 1422.048134] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 1422.133806] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 1423.712137] Key type lgssc registered [ 1424.046566] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1436.262417] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1436.267687] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1437.355348] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1437.369128] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1437.405051] Lustre: lustre-MDT0000: new disk, initializing [ 1437.427753] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1437.433887] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1438.834510] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1442.937184] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1443.039800] Lustre: lustre-OST0000: new disk, initializing [ 1443.041894] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1443.044262] Lustre: Skipped 1 previous similar message [ 1443.046760] Lustre: 117600:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1443.070674] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1444.478134] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1444.481295] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1444.491223] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1444.984793] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1448.857646] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1448.912134] Lustre: lustre-OST0001: new disk, initializing [ 1448.913660] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1448.915875] Lustre: 118463:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1448.938792] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1450.663229] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1454.092399] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1454.095824] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1454.104752] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1454.623557] Lustre: server umount lustre-MDT0000 complete [ 1456.645890] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 1458.077109] LustreError: 116784:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354537 with bad export cookie 8931372550751171069 [ 1458.081765] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1468.414276] Lustre: server umount lustre-OST0000 complete [ 1478.810902] Lustre: server umount lustre-OST0001 complete [ 1481.650281] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 09:09:19 (1788354559) [ 1488.663120] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 09:09:26 (1788354566) [ 1491.595381] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1498.514329] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 09:09:36 (1788354576) [ 1510.094915] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 1513.145587] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1523.672403] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1523.751928] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1523.761490] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1523.801722] Lustre: lustre-MDT0000: new disk, initializing [ 1523.821605] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1523.828426] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1525.071016] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1529.168486] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1529.216798] Lustre: 126198:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1529.237970] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1529.239823] Lustre: Skipped 1 previous similar message [ 1529.277494] Lustre: lustre-MDT0001: new disk, initializing [ 1529.310801] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1529.323491] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1529.327670] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1530.715616] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1534.513896] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1536.440459] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1538.742812] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1538.851169] Lustre: lustre-OST0000: new disk, initializing [ 1538.853187] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1538.857543] Lustre: 128164:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1538.885622] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1540.901711] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1542.137044] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1542.141226] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1542.171278] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1544.701563] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1546.190574] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1546.269731] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1547.710258] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1547.787169] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1552.357752] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1552.357947] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1552.358682] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1552.362294] Lustre: Skipped 1 previous similar message [ 1552.370424] LustreError: Skipped 1 previous similar message [ 1554.584829] Lustre: server umount lustre-OST0000 complete [ 1557.473422] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1557.474141] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1557.477612] Lustre: Skipped 1 previous similar message [ 1557.479476] Lustre: Skipped 1 previous similar message [ 1562.593238] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1562.596447] Lustre: Skipped 2 previous similar messages [ 1567.713237] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1567.716109] Lustre: Skipped 1 previous similar message [ 1570.272085] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1570.330340] Lustre: server umount lustre-MDT0000 complete [ 1571.527039] LustreError: 126191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354650 with bad export cookie 8931372550751172273 [ 1571.529477] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1571.530739] LustreError: 126191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1571.628549] Lustre: server umount lustre-MDT0001 complete [ 1574.260454] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 09:10:52 (1788354652) [ 1576.423625] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1576.601147] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1577.871769] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1580.708518] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1582.123200] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1584.332813] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1586.090374] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1588.265616] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1590.206063] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1592.546816] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1605.357116] Lustre: *** cfs_fail_loc=159, val=0*** [ 1620.746755] Lustre: lustre-MDT0000: Client a7e83754-f765-4f9c-849c-063aa5d45fdc (at 192.168.203.22@tcp) reconnecting [ 1621.246441] Lustre: *** cfs_fail_loc=159, val=0*** [ 1621.248079] Lustre: Skipped 5 previous similar messages [ 1636.618068] Lustre: lustre-MDT0000: Client a7e83754-f765-4f9c-849c-063aa5d45fdc (at 192.168.203.22@tcp) reconnecting [ 1653.216833] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1653.220244] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1653.228439] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1657.315423] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1657.319846] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1658.577967] Lustre: server umount lustre-OST0000 complete [ 1662.433559] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1662.434308] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1662.439137] Lustre: Skipped 1 previous similar message [ 1662.440788] Lustre: Skipped 2 previous similar messages [ 1674.208113] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1674.268279] Lustre: server umount lustre-MDT0000 complete [ 1675.397983] LustreError: 132411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354754 with bad export cookie 8931372550751173141 [ 1675.400559] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1675.401101] LustreError: 132411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1675.505969] Lustre: server umount lustre-MDT0001 complete [ 1678.891373] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 1679.858277] Key type lgssc unregistered [ 1679.985390] LNet: 134365:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1679.988370] LNetError: 134365:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1679.998442] LNet: Removed LNI 192.168.203.122@tcp [ 1680.281876] Key type .llcrypt unregistered [ 1680.282913] Key type ._llcrypt unregistered [ 1688.958358] Key type ._llcrypt registered [ 1688.959570] Key type .llcrypt registered [ 1689.002270] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1689.309850] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1689.327806] alg: No test for adler32 (adler32-zlib) [ 1690.175682] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 1690.260949] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 1691.840148] Key type lgssc registered [ 1692.170196] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1694.694968] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1694.702859] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1695.835157] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1697.142055] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1699.767806] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1699.877574] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1701.136912] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1703.325299] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1704.965793] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1707.011829] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1707.131679] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1708.891461] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1711.158150] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1721.450125] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 1726.100909] Lustre: *** cfs_fail_loc=159, val=0*** [ 1741.580642] Lustre: lustre-MDT0000: Client 2d271f2d-8012-4166-ba93-7c2f208e873b (at 192.168.203.22@tcp) reconnecting [ 1742.376431] Lustre: *** cfs_fail_loc=159, val=0*** [ 1757.945302] Lustre: lustre-MDT0001: Client 2d271f2d-8012-4166-ba93-7c2f208e873b (at 192.168.203.22@tcp) reconnecting [ 1758.473841] Lustre: *** cfs_fail_loc=159, val=0*** [ 1758.475972] Lustre: Skipped 5 previous similar messages [ 1773.829857] Lustre: lustre-MDT0001: Client 2d271f2d-8012-4166-ba93-7c2f208e873b (at 192.168.203.22@tcp) reconnecting [ 1789.413994] Lustre: 138834:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1790.270934] Lustre: *** cfs_fail_loc=159, val=0*** [ 1790.273291] Lustre: Skipped 3 previous similar messages [ 1805.576424] Lustre: lustre-MDT0000: Client 0f1ade4f-b7e9-4888-aad6-3a2adae858aa (at 192.168.203.22@tcp) reconnecting [ 1806.106225] Lustre: *** cfs_fail_loc=159, val=0*** [ 1806.108829] Lustre: Skipped 12 previous similar messages [ 1822.471791] Lustre: lustre-MDT0000: Client 0f1ade4f-b7e9-4888-aad6-3a2adae858aa (at 192.168.203.22@tcp) reconnecting [ 1823.047931] Lustre: 139125:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1838.560837] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1838.563362] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1838.567577] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1839.587531] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1839.588030] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1839.588259] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1839.596785] Lustre: Skipped 1 previous similar message [ 1843.469168] Lustre: server umount lustre-OST0000 complete [ 1848.288937] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1848.291363] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1848.295517] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1850.967301] Lustre: server umount lustre-MDT0000 complete [ 1852.232483] LustreError: 135736:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788354931 with bad export cookie 1642418035578144940 [ 1852.235867] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1852.238747] LustreError: 135736:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1852.360097] Lustre: server umount lustre-MDT0001 complete [ 1856.213441] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 1857.251288] Key type lgssc unregistered [ 1857.385526] LNet: 140200:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1857.387815] LNetError: 140200:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1857.398279] LNet: Removed LNI 192.168.203.122@tcp [ 1857.694422] Key type .llcrypt unregistered [ 1857.695582] Key type ._llcrypt unregistered [ 1866.360572] Key type ._llcrypt registered [ 1866.361682] Key type .llcrypt registered [ 1866.395419] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1866.695198] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1866.762502] alg: No test for adler32 (adler32-zlib) [ 1867.614975] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 1867.701872] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 1869.280119] Key type lgssc registered [ 1869.636406] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1872.208703] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1872.214993] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1873.358928] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1874.696320] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1877.517148] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1877.642963] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1878.978605] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1881.481717] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1883.307946] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1885.495699] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1885.606507] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1887.497146] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1887.655510] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 1889.810602] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1897.895713] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 1902.419184] Lustre: 144186:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1903.052590] Lustre: 144234:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1903.493330] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 1904.566765] Lustre: 144381:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 1904.854362] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 1904.857400] Lustre: Skipped 1 previous similar message [ 1905.140134] Lustre: 144479:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1908.194638] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1908.195938] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1908.196960] LustreError: Skipped 1 previous similar message [ 1908.196971] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1908.200870] Lustre: Skipped 1 previous similar message [ 1912.142027] Lustre: server umount lustre-OST0000 complete [ 1913.824878] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1913.827454] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1913.831503] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1913.833121] Lustre: Skipped 1 previous similar message [ 1918.433042] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1918.433593] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1919.450906] Lustre: server umount lustre-MDT0000 complete [ 1920.653192] LustreError: 144283:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355000 with bad export cookie 645535954971363319 [ 1920.657329] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1920.658494] LustreError: 144283:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1920.767301] Lustre: server umount lustre-MDT0001 complete [ 1924.333589] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 1925.320833] Key type lgssc unregistered [ 1925.443333] LNet: 145537:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1925.446051] LNetError: 145537:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1925.454280] LNet: Removed LNI 192.168.203.122@tcp [ 1925.771715] Key type .llcrypt unregistered [ 1925.772808] Key type ._llcrypt unregistered [ 1934.645166] Key type ._llcrypt registered [ 1934.646119] Key type .llcrypt registered [ 1934.682032] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 1934.982803] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1935.005292] alg: No test for adler32 (adler32-zlib) [ 1935.853988] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 1935.940905] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 1937.520177] Key type lgssc registered [ 1937.908168] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1940.450400] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1940.464249] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1941.616717] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1942.967709] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1945.668686] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1945.793029] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1947.053930] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1949.453282] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1951.190195] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1953.418484] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1953.533398] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1955.372525] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 1956.645700] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 1957.700836] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1965.863951] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 1970.468173] Lustre: *** cfs_fail_loc=159, val=0*** [ 1985.798123] Lustre: lustre-MDT0000: Client 60277f91-dd22-4216-8b08-c2c39206ca3f (at 192.168.203.22@tcp) reconnecting [ 1987.553301] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1987.558084] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1987.566435] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1991.651048] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1991.651456] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1991.651717] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1991.659553] Lustre: Skipped 1 previous similar message [ 1993.105089] Lustre: server umount lustre-OST0000 complete [ 1996.769645] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1996.770769] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1996.773318] Lustre: Skipped 1 previous similar message [ 2000.478819] Lustre: server umount lustre-MDT0000 complete [ 2001.702940] LustreError: 146957:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355081 with bad export cookie 8293286429668970602 [ 2001.706307] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2001.707649] LustreError: 146957:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2001.835471] Lustre: server umount lustre-MDT0001 complete [ 2005.449084] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 2006.472397] Key type lgssc unregistered [ 2006.591323] LNet: 150611:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2006.594479] LNetError: 150611:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2006.604293] LNet: Removed LNI 192.168.203.122@tcp [ 2006.923762] Key type .llcrypt unregistered [ 2006.924836] Key type ._llcrypt unregistered [ 2016.103698] Key type ._llcrypt registered [ 2016.104912] Key type .llcrypt registered [ 2016.143482] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2016.587032] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2016.595161] alg: No test for adler32 (adler32-zlib) [ 2017.449069] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 2017.551106] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 2019.136124] Key type lgssc registered [ 2019.524370] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2022.118626] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2022.123944] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2023.271578] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2024.643564] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2027.518848] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2027.658493] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2029.080664] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2031.544705] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2033.341375] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2035.743033] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2035.870878] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2036.904494] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2037.837735] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2040.248518] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2048.168880] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2063.550726] Lustre: lustre-OST0000: evicting b70cbde1-7fe1-4249-a491-9a97f490acce (at 192.168.203.22@tcp) by administrative request [ 2063.554702] Lustre: Skipped 1 previous similar message [ 2088.416686] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2088.418599] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2088.422286] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2089.443214] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2089.443610] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2089.444144] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2093.582985] Lustre: server umount lustre-OST0000 complete [ 2099.681975] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2099.682339] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2099.683096] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2099.683100] Lustre: Skipped 1 previous similar message [ 2099.698342] Lustre: Skipped 1 previous similar message [ 2100.947967] Lustre: server umount lustre-MDT0000 complete [ 2102.234447] LustreError: 151983:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355181 with bad export cookie 6679927660811434678 [ 2102.237548] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2102.239825] LustreError: 151983:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2102.366722] Lustre: server umount lustre-MDT0001 complete [ 2106.168513] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 2107.215994] Key type lgssc unregistered [ 2107.356309] LNet: 156089:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2107.360201] LNetError: 156089:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2107.367266] LNet: Removed LNI 192.168.203.122@tcp [ 2107.683131] Key type .llcrypt unregistered [ 2107.684290] Key type ._llcrypt unregistered [ 2130.241581] Key type ._llcrypt registered [ 2130.242607] Key type .llcrypt registered [ 2130.276456] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2130.655446] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2130.671032] alg: No test for adler32 (adler32-zlib) [ 2131.504317] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 2131.583823] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 2133.160086] Key type lgssc registered [ 2133.475096] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2135.801714] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2135.806953] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2136.949052] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2138.230585] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2141.163856] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2141.299420] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2142.733586] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2145.311947] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2147.277841] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2149.569305] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2149.693918] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2150.760279] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 2151.682814] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2154.198270] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2163.048481] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 2168.291282] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2168.292269] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2168.294427] Lustre: Skipped 1 previous similar message [ 2168.294606] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2168.296778] Lustre: Skipped 1 previous similar message [ 2169.740559] Lustre: server umount lustre-OST0000 complete [ 2171.872849] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2171.877394] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2171.885183] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2173.408963] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2173.409739] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2176.980378] Lustre: server umount lustre-MDT0000 complete [ 2178.157123] LustreError: 160395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355257 with bad export cookie 2310227647128647507 [ 2178.160292] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2178.161699] LustreError: 160395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2178.282458] Lustre: server umount lustre-MDT0001 complete [ 2181.687835] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 2182.669751] Key type lgssc unregistered [ 2182.795458] LNet: 162103:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2182.798691] LNetError: 162103:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2182.805497] LNet: Removed LNI 192.168.203.122@tcp [ 2183.088719] Key type .llcrypt unregistered [ 2183.089783] Key type ._llcrypt unregistered [ 2191.671343] Key type ._llcrypt registered [ 2191.672656] Key type .llcrypt registered [ 2191.704116] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2192.054393] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2192.064670] alg: No test for adler32 (adler32-zlib) [ 2192.896265] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 2192.967901] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 2194.544123] Key type lgssc registered [ 2194.871494] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2199.283810] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 09:21:17 (1788355277) [ 2203.898588] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 2206.759871] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2218.335788] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2218.343271] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2219.427546] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2219.441501] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2219.487099] Lustre: lustre-MDT0000: new disk, initializing [ 2219.511417] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2219.517630] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2220.849453] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2224.915634] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2224.956915] Lustre: 166333:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2224.980629] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2224.982681] Lustre: Skipped 1 previous similar message [ 2225.016451] Lustre: lustre-MDT0001: new disk, initializing [ 2225.047431] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2225.059606] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2225.062763] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2226.369863] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2230.031827] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2231.784228] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2233.995491] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2234.110321] Lustre: lustre-OST0000: new disk, initializing [ 2234.112782] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2234.116572] Lustre: 168300:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2234.149920] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2235.967254] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2239.485159] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2239.489070] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2239.525173] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2239.702365] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2244.577875] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2244.580056] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2244.581672] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2244.584390] Lustre: Skipped 1 previous similar message [ 2248.980868] Lustre: server umount lustre-OST0000 complete [ 2250.720766] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2250.724144] LustreError: Skipped 1 previous similar message [ 2250.725977] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2250.731461] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2250.732953] Lustre: Skipped 1 previous similar message [ 2254.817182] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2254.817722] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2256.350587] Lustre: server umount lustre-MDT0000 complete [ 2257.573175] LustreError: 167128:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355336 with bad export cookie 8443086589476728685 [ 2257.576294] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2257.578607] LustreError: 167128:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2257.698527] Lustre: server umount lustre-MDT0001 complete [ 2261.218745] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 2262.187264] Key type lgssc unregistered [ 2262.319357] LNet: 170204:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2262.321743] LNetError: 170204:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2262.331287] LNet: Removed LNI 192.168.203.122@tcp [ 2262.618507] Key type .llcrypt unregistered [ 2262.620243] Key type ._llcrypt unregistered [ 2271.596496] Key type ._llcrypt registered [ 2271.597757] Key type .llcrypt registered [ 2271.640727] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2271.956940] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2271.999148] alg: No test for adler32 (adler32-zlib) [ 2272.850573] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 2272.935763] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 2274.512147] Key type lgssc registered [ 2274.852722] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2277.435752] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2277.441329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2278.592163] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2280.076564] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2282.919143] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2283.049063] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2284.445532] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2286.925200] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2288.813227] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2290.998048] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2291.111371] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2292.981402] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2295.351725] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2304.423200] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 2307.997753] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2308.003805] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2308.008613] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2308.011653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2308.014888] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2308.335073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2308.658109] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2308.661806] Lustre: Skipped 1 previous similar message [ 2308.668268] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2308.674134] Lustre: Skipped 1 previous similar message [ 2308.676389] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2308.679745] Lustre: Skipped 1 previous similar message [ 2308.681910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2308.687401] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2308.691128] Lustre: Skipped 1 previous similar message [ 2308.965173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2309.254476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2309.523620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2309.828275] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2309.830610] Lustre: Skipped 3 previous similar messages [ 2309.836687] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2309.842008] Lustre: Skipped 3 previous similar messages [ 2309.843238] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2309.844900] Lustre: Skipped 3 previous similar messages [ 2309.846150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2309.851603] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2309.854811] Lustre: Skipped 3 previous similar messages [ 2310.134843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2310.425112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2310.724179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2311.049698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2311.342742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2311.650809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2311.933801] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2311.935779] Lustre: Skipped 6 previous similar messages [ 2311.940138] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2311.943677] Lustre: Skipped 6 previous similar messages [ 2311.945122] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2311.947011] Lustre: Skipped 6 previous similar messages [ 2311.948281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2311.952195] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2311.955980] Lustre: Skipped 6 previous similar messages [ 2312.253653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2312.532611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2312.810057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2313.103734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2313.424814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2313.709121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2314.001690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2314.293829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2314.596106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2314.861911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2315.146936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2315.448671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2315.740439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2316.009205] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2316.011066] Lustre: Skipped 13 previous similar messages [ 2316.015719] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2316.019105] Lustre: Skipped 13 previous similar messages [ 2316.020512] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2316.022442] Lustre: Skipped 13 previous similar messages [ 2316.024348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2316.029281] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2316.031159] Lustre: Skipped 13 previous similar messages [ 2316.315039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2316.595458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2316.899637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2317.208320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2317.497805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2317.772907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2318.063508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2318.358650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2318.643113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2318.947722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2319.256407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2319.562660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2319.877494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2320.156736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2320.433524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2320.716772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2320.995135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2321.280968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2321.555963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2321.830098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2322.136055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2322.419478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2322.717239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2323.016605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2323.287732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2323.572340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2323.868203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2324.146694] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2324.149637] Lustre: Skipped 27 previous similar messages [ 2324.155211] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2324.160675] Lustre: Skipped 27 previous similar messages [ 2324.162745] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2324.166863] Lustre: Skipped 27 previous similar messages [ 2324.169341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2324.174700] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2324.178412] Lustre: Skipped 27 previous similar messages [ 2324.491890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2324.788235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2325.084498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2325.370386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2325.667948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2325.960584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2326.270174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2326.557734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2326.845275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2327.138052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2327.444125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2327.754519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2328.048511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2328.357384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2328.676593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2328.967883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2329.261980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2329.568042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2329.892732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2330.180911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2330.480989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2330.787154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2331.102339] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2331.105863] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2331.111866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2331.409592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2331.696262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2331.987319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2332.300883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2332.580970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2332.880757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2333.181771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2333.475927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2333.775195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2334.055310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2334.347324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2334.644050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2334.940576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2335.234534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2335.542298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2335.854771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2336.141185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2336.428051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2336.713592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2337.018347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2337.315406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2337.608613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2337.909647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2338.214542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2338.504243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2338.803765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2339.093671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2339.392705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2339.682827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2339.972854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2340.273496] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2340.275620] Lustre: Skipped 53 previous similar messages [ 2340.280529] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2340.284590] Lustre: Skipped 53 previous similar messages [ 2340.286494] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2340.288864] Lustre: Skipped 53 previous similar messages [ 2340.290537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2340.293811] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2340.295988] Lustre: Skipped 53 previous similar messages [ 2340.596485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2340.879571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2341.165741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2341.465510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2341.769567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2342.068496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2342.357747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2342.656807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2342.968149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2343.279129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2343.627903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2343.928383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2344.243100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2344.538221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2344.844102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2345.183471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2345.500862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2345.799863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2346.101817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2346.405512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2346.720101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2347.021802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2347.323974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2347.617093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2347.922554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2348.214468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2348.506393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2348.802162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2349.090343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2349.375823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2349.658198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2349.935542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2350.222357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2350.548095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2350.870748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2351.172027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2351.479983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2351.766841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2352.069038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2352.371915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2352.717271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2353.007909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2353.306191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2353.600390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2353.904970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2354.207471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2354.493396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2354.770586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.078046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.380780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.675071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.963364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2356.266631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2356.554082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2356.857575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2357.150666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2357.459918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2357.746833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2358.051546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2358.361381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2358.686944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.000354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.296762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.591202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.901664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2360.189666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2360.485072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2360.787123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.107940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.412798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.726899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2362.030713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2362.347107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2362.642158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2362.956526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2363.269883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2363.571727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2363.885527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2364.207126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2364.518956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2364.860536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2365.169096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2365.461355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2365.769240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.083210] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2366.086291] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2366.086935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.398255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.695144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.984346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2367.289097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2367.599045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2367.917620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2368.235447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2368.568194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2368.874838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.197744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.509217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.837982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2370.130078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2370.420469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2370.716299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.029178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.308185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.613466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.895769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2372.206275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2372.492065] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2372.494958] Lustre: Skipped 105 previous similar messages [ 2372.501484] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2372.505322] Lustre: Skipped 105 previous similar messages [ 2372.507489] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2372.510551] Lustre: Skipped 105 previous similar messages [ 2372.512649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2372.516568] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2372.519319] Lustre: Skipped 105 previous similar messages [ 2372.800947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2373.105614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2373.426638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2373.722649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.024416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.322150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.630486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.921806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2375.215213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2375.506179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2375.812232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2376.108159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2376.420763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2376.720150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2377.018088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2377.314489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2377.617485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2377.929910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2378.248224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2378.556525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2378.862608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2379.171415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2379.489471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2379.786359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2380.097970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2380.404350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2380.723655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2381.045222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2381.360134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2381.677675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.017390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.325279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.637805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.940070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2383.264026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2383.566291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2383.872515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2384.174595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2384.499528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2384.792603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.095121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.404244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.721160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2386.029642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2386.357298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2386.655131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2386.985786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2387.274845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2387.572910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2387.885499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2388.195599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2388.490957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2388.781563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2389.082895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2389.413566] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2389.418116] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2389.418188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2389.731090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.042732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.329938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.648493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.955249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2391.272710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2391.590303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2391.910948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2392.218600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2392.525598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2392.829695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2393.141231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2393.450338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2393.755435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2394.054276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2394.372432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2394.688342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.007458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.320211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.662694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.958885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2396.245708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2396.527042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2396.835795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2397.128395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2397.428970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2397.720563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.024995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.331822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.652227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.954287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2399.280563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2399.580431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2399.883045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2400.206952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2400.559122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2400.884407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2401.191732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2401.507642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2401.838194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2402.138685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2402.444852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2402.747647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2403.081266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2403.415910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2403.735604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2404.053972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2404.399710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2404.710170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.037099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.345568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.668856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.976273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2406.283711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2406.583941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2406.900270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2407.222667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2407.529500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2407.822391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2408.155812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2408.471958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2408.790251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2409.098088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2409.422821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2409.722705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.032417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.335341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.678189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.991424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2411.328415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2411.659121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2411.997505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.313355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.635776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.957171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2413.304973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2413.633938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2413.962024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2414.275145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2414.639237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2414.952359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2415.280221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2415.609917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2415.959426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2416.299251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2416.621136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2416.943207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.273116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.585263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.914416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2418.236767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2418.601990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2418.931967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2419.256439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2419.562297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2419.912294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2420.246921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2420.574428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2420.898089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2421.248477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2421.563681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2421.881892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2422.177592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2422.462709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2422.738997] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.020545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.308478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.585472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.853118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.125437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.390192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.658339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.926754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2425.217460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2425.522974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2425.805119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.089340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.371404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.656349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.963311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2427.232744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2427.520820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2427.802456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.125448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.437747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.755945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2429.072861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2429.376551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2429.661156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2429.942548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.210663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.480514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.765636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.054251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.341035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.625076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.903082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.195227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.489063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.845328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2433.133189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2433.413272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2433.697512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.022408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.331261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.631566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.952689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2435.284594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2435.616623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2435.920762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2436.212181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2436.514468] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2436.516819] Lustre: Skipped 206 previous similar messages [ 2436.522167] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2436.525165] Lustre: Skipped 206 previous similar messages [ 2436.526375] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2436.528318] Lustre: Skipped 206 previous similar messages [ 2436.529546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2436.532859] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2436.534981] Lustre: Skipped 206 previous similar messages [ 2436.811703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.095279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.382350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.670817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.941671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2438.254345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2438.569575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2438.904096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2439.210024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2439.511225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2439.825350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2440.156825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2440.468208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2440.764697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.081723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.372860] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2441.376389] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2441.376808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.659221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.940956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2442.227381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2442.513870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2442.803177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.084877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.368634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.656381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.938953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2444.210418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2444.488538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2444.786414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.057588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.316878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.598302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.889567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2446.169219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2446.441630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2446.719184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.016720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.309413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.597874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.864799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.142228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.423038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.706812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.996203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2449.290173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2449.573664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2449.857937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2450.141734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2450.434601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2450.709117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.020666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.325262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.626513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.920960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2452.206790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2452.494923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2452.793070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.076995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.371557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.666838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.981294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2454.268241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2454.555651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2454.829269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.109641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.382881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.661711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.926535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2456.217834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2456.487509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2456.767281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.053811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.341594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.615187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.888520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.161175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.442134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.708373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.986428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2459.265090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2459.540294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2459.823940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.111517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.396375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.690561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.984790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2461.260233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2461.538223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2461.830798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2462.127592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2462.427417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2462.719605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.011322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.304936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.588080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.865098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.162821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.442032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.716809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.971886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2465.249840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2465.514900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2465.766824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.057964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.345398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.622358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.890417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.155032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.438288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.709150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.980549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2468.260708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2468.546154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2468.823185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.093957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.365859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.650671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.929751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2470.208125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2470.483314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2470.766183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.041684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.313348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.591604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.876949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.146455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.416426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.692444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.985106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2473.278481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2473.581907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2473.884644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2474.172063] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2474.175066] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2474.175877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2474.464139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2474.748268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.026302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.328293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.616164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.908623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2476.177481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2476.460034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2476.743085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.013857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.293780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.575872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.849905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.126224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.400064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.709926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.007874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.316768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.619209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.922202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2480.217370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2480.520563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2480.830965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2481.149749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2481.444736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2481.761376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.067240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.374145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.666653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.964177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2483.269833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2483.581525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2483.879575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2484.186377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2484.527581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2484.861489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2485.156733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2485.435760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2485.724253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.006883] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2486.010077] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2486.010764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.287893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.565566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.848904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2487.154417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2487.464543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2487.767941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2488.081325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2488.412049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2488.730286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.038276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.338430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.661950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.978519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2490.301306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2490.629534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2490.985522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2491.304662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2491.625056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2491.957691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2492.302541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2492.641546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2492.958491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2493.270891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2493.596086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2493.892531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.192084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.473764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.784588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2495.104653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2495.407454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2495.714718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.043075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.333982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.625561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.921577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2497.243039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2497.526202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2497.809364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2498.101590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2498.399614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2498.696342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.004301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.300128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.612496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.921948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2500.247098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2500.545613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2500.869909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2501.176438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2501.490212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2501.767936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.067915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.369204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.656891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.938385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2503.257534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2503.559940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2503.861865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2504.163172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2504.497032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2504.805587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.107064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.433083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.752996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.038504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.350875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.646595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.968157] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2506.972293] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2506.972762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2507.286658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2507.588969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2507.881483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2508.187171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2508.477563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2508.790990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2509.106298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2509.421678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2509.722511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.023229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.325518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.634622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.924929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2511.230836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2511.517556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2511.823458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2512.124578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2512.426231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2512.705165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.027620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.332687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.637275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.941426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2514.279805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2514.580042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2514.864968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2515.146535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2515.447808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2515.723219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.001688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.304228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.600042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.879059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2517.169941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2517.476143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2517.792572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.077438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.380178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.662764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.960258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2519.244445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2519.542401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2519.840893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2520.155856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2520.449167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2520.742569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.030108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.342171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.624296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.914530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2522.196307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2522.484759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2522.770051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.049394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.360187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.688059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.988288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2524.293473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2524.590631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2524.888699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2525.178578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2525.467583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2525.747165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.057819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.352791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.637417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.929414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2527.243277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2527.532585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2527.814674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.118670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.418353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.690325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.974984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2529.264514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2529.546737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2529.859591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2530.170263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2530.456654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2530.752971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.034314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.317801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.583872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.874325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2532.149970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2532.430899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2532.720618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.026463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.306767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.583894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.864944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.148100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.426459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.710179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.998816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2535.289177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2535.588377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2535.889663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2536.184767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2536.478026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2536.753042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.033562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.327440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.613458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.895569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2538.186730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2538.470667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2538.774601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.056584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.341553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.619205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.907416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2540.191165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2540.477599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2540.764747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.081874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.368926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.671955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.953215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2542.246392] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2542.249173] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 2 previous similar messages [ 2542.251310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2542.251513] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2542.258483] LustreError: 171614:0:(osp_precreate.c:1359:osp_precreate_thread()) Skipped 2 previous similar messages [ 2542.545722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2542.855805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2543.165304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2543.463677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2543.750764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.051066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.361984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.661216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.947399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.234846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.543349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.860146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2546.149746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2546.437145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2546.721849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.032915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.330352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.620737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.910538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2548.220687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2548.506200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2548.809490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2549.109887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2549.414651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2549.720069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.015084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.306564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.626694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.934970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2551.226612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2551.536513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2551.857817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2552.152201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2552.456821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2552.748865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.069418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.365220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.670320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.956625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2554.267354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2554.562921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2554.856847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2555.143255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2555.473943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2555.789569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.098404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.390785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.726240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.041300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.340202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.638218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.963120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2558.268269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2558.568559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2558.869444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2559.177111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2559.488956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2559.812886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2560.121027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2560.449649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2560.740261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.035619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.323403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.639194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.933813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.226239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.524036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.834885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.133402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.424414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.713528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.011874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.302793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.587389] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2564.589444] Lustre: Skipped 433 previous similar messages [ 2564.594241] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2564.597691] Lustre: Skipped 433 previous similar messages [ 2564.599155] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2564.602509] Lustre: Skipped 433 previous similar messages [ 2564.604808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.610731] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2564.614339] Lustre: Skipped 433 previous similar messages [ 2564.906656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.222475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.516225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.810708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.100172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.425247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.741146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.045784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.344966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.638279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.928982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.220694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.512867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.824959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.129205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.418910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.721082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.031269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.330983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.643790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.937746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.239957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.540102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.840644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.131556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.439691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.749637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.057231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.350982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.656841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.942969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.240819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.520142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.827994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.138049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.431632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.748970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.072524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.364581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.665318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.967776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.280084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.585413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.891907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.193223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.517932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.809042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.114345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.411452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.733669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.027037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.313029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.610595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.933281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.226768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.524922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.824945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.144186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.437142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.733924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.014626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.308091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.605584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.905912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.200346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.505337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.790121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.080412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.371025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.677443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.967877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.266204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.562811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.886844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.177818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.462508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.758418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.067774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.378569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.681740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.973967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.279524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.589781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.895919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.189852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.499816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.824480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.129161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.425506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.737363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.029855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.318118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.603363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.930340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.231065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.539453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.847878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.187542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.490680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.793053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.085624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.396859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.704711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.024868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.338541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.663709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.975033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.264952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.557082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.873073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.180507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.478215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.774424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.148784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.460516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.777733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.082057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.395229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.702384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.026488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.329687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.666203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.974886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.293429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.611284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.972875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.308441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.627654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.936918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.263314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.567865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.877754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.190762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.532822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.848111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.161944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.465680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.793154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.114360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.419639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.722496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.044122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.348915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.858830] LustreError: 173413:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 2670.861686] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 2670.867395] LustreError: 171614:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 2 previous similar messages [ 2733.537439] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2733.540032] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2735.417057] Lustre: server umount lustre-OST0000 complete [ 2737.634367] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2737.636544] Lustre: Skipped 1 previous similar message [ 2742.753041] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2742.754911] Lustre: Skipped 1 previous similar message [ 2745.907552] Lustre: server umount lustre-MDT0000 complete [ 2747.055288] LustreError: 171575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355826 with bad export cookie 230457216982440617 [ 2747.058118] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2747.058759] LustreError: 171575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2747.172486] Lustre: server umount lustre-MDT0001 complete [ 2750.486539] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 2751.388540] Key type lgssc unregistered [ 2751.491287] LNet: 226621:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2751.493368] LNetError: 226621:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2751.501242] LNet: Removed LNI 192.168.203.122@tcp [ 2751.761669] Key type .llcrypt unregistered [ 2751.762836] Key type ._llcrypt unregistered [ 2760.144297] Key type ._llcrypt registered [ 2760.145373] Key type .llcrypt registered [ 2760.181230] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2760.453194] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2760.493445] alg: No test for adler32 (adler32-zlib) [ 2761.330426] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 2761.405557] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 2762.984119] Key type lgssc registered [ 2763.378455] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2766.628848] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2766.639995] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2767.845646] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2769.904535] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2773.803776] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2773.980093] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2775.941059] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2779.531710] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2783.507054] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2788.453417] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2788.727476] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2792.840404] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 2794.067727] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2798.964766] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2801.893125] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2802.536769] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2802.542148] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2802.545269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.548474] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2802.548507] LustreError: 228031:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 2804.194429] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2804.200111] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2804.200325] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2804.205164] Lustre: Skipped 1 previous similar message [ 2805.265308] Lustre: server umount lustre-OST0000 complete [ 2822.624136] LustreError: 228031:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 2833.348045] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2833.466996] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2835.452759] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2838.108934] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2843.681969] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2843.687140] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2843.687305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.979349] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 10 sec [ 2850.738146] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9148c43be800.ost_server_uuid 50 [ 2851.227873] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9148c43be800.ost_server_uuid in FULL state after 0 sec [ 2853.857525] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2853.859353] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2853.861729] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2853.865590] Lustre: Skipped 2 previous similar messages [ 2858.313325] Lustre: server umount lustre-OST0000 complete [ 2861.024738] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2861.026682] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2861.030110] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2861.034205] Lustre: Skipped 1 previous similar message [ 2864.097195] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2864.099939] Lustre: Skipped 1 previous similar message [ 2865.687427] Lustre: server umount lustre-MDT0000 complete [ 2866.877269] LustreError: 230746:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788355946 with bad export cookie 1965530882274569739 [ 2866.881082] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2866.882176] LustreError: 230746:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2866.992221] Lustre: server umount lustre-MDT0001 complete [ 2870.720136] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 2871.734447] Key type lgssc unregistered [ 2871.858345] LNet: 233242:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2871.861440] LNetError: 233242:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2871.869305] LNet: Removed LNI 192.168.203.122@tcp [ 2872.218137] Key type .llcrypt unregistered [ 2872.219251] Key type ._llcrypt unregistered [ 2884.516645] Key type ._llcrypt registered [ 2884.518094] Key type .llcrypt registered [ 2884.555207] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2884.974178] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2884.987835] alg: No test for adler32 (adler32-zlib) [ 2885.842612] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 2885.935207] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 2887.520136] Key type lgssc registered [ 2887.866382] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2891.029225] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2891.035868] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2892.168806] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2893.509162] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2896.437331] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2896.566328] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2897.907514] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2898.870963] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 2900.976833] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2901.097310] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2902.119376] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 2903.183042] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2906.189107] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2906.261788] Lustre: lustre-OST0001: new disk, initializing [ 2906.263861] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2906.266749] Lustre: 237254:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2906.298077] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2908.378341] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2912.773318] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2912.777230] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2912.806687] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2913.949876] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2918.712868] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 2927.584938] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2927.587568] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2927.592231] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2928.097286] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2928.099742] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2928.105620] Lustre: Skipped 2 previous similar messages [ 2931.296974] Lustre: server umount lustre-MDT0000 complete [ 2932.657792] LustreError: 238192:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356012 with bad export cookie 14241930418684747197 [ 2932.662842] LustreError: 238192:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2932.663912] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2932.664110] LustreError: 235682:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 2932.794735] Lustre: server umount lustre-MDT0001 complete [ 2944.451801] Lustre: server umount lustre-OST0000 complete [ 2956.195558] Lustre: server umount lustre-OST0001 complete [ 2964.226822] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 2967.969441] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2968.148650] LustreError: 240353:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2968.157952] LustreError: 240353:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2968.173353] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2969.722056] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2973.041759] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2974.666989] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2975.727192] Lustre: 241493:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 2978.171310] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2978.298086] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2978.300492] Lustre: Skipped 1 previous similar message [ 2979.303116] LustreError: 241847:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2979.308102] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 2980.483454] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2983.398896] LustreError: 241848:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2983.404907] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 2983.406206] LustreError: 241848:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2983.724144] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2985.904083] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 2989.033465] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 2989.206653] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2990.440758] Lustre: 243366:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 2998.753503] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2998.756902] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2998.762784] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2998.764850] Lustre: Skipped 3 previous similar messages [ 3001.123163] Lustre: server umount mylustre-MDT0000 complete [ 3002.487151] LustreError: 240330:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356081 with bad export cookie 14241930418684749920 [ 3002.491274] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3002.491576] LustreError: 240330:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 3002.609066] Lustre: server umount mylustre-MDT0001 complete [ 3014.602884] Lustre: server umount mylustre-OST0000 complete [ 3026.273246] Lustre: server umount mylustre-OST0001 complete [ 3034.003318] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3037.578580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3037.727940] LustreError: 245670:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3037.751189] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3037.754415] Lustre: Skipped 1 previous similar message [ 3039.194855] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3042.108793] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3043.706042] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3044.756523] Lustre: 246814:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3047.110094] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3048.292735] LustreError: 247167:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3048.296702] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 3049.266978] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3052.252434] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3053.419295] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 3053.421551] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 3054.461280] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3057.889240] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3059.288161] Lustre: 248681:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3062.753085] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3062.756989] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3062.762897] Lustre: Skipped 3 previous similar messages [ 3062.765557] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 3062.767382] Lustre: Skipped 4 previous similar messages [ 3067.621139] Lustre: server umount tfs-MDT0000 complete [ 3068.901676] LustreError: 245667:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3068.908251] LustreError: 245667:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 3068.956242] LustreError: 245645:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356148 with bad export cookie 14241930418684752097 [ 3068.960724] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3068.962975] LustreError: 245645:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3069.098550] Lustre: server umount tfs-MDT0001 complete [ 3080.196454] Lustre: server umount tfs-OST0000 complete [ 3090.722699] Lustre: server umount tfs-OST0001 complete [ 3098.582680] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3102.499906] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3102.667298] LustreError: 250929:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3102.688132] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3102.691242] Lustre: Skipped 3 previous similar messages [ 3104.100413] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3107.109377] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3108.731388] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3109.722833] Lustre: 252072:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3111.968295] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3113.128278] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 3114.207207] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3117.226273] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 3117.263900] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3119.492399] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3122.673145] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 3122.943651] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3124.273412] Lustre: 253939:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3126.725654] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 09:36:44 (1788356204) [ 3143.143188] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3143.143336] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3143.144744] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3143.144751] Lustre: Skipped 4 previous similar messages [ 3143.147763] Lustre: Skipped 6 previous similar messages [ 3144.795891] Lustre: server umount lustre-MDT0000 complete [ 3146.033085] LustreError: 250905:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356225 with bad export cookie 14241930418684754008 [ 3146.036409] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3146.038506] LustreError: 250905:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3148.257614] LustreError: 251661:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3148.263567] LustreError: 251661:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 3151.265637] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3151.267767] Lustre: Skipped 6 previous similar messages [ 3152.239834] Lustre: server umount lustre-MDT0001 complete [ 3159.679036] Lustre: server umount lustre-OST0000 complete [ 3175.392301] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3175.461149] Lustre: server umount lustre-OST0001 complete [ 3177.790599] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 3181.003410] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3192.881096] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 3192.881096] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3192.881096] [ 3192.902850] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3192.982687] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3192.993913] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3193.030293] Lustre: lustre-MDT0000: new disk, initializing [ 3193.050959] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3193.053022] Lustre: Skipped 3 previous similar messages [ 3193.059102] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3194.420920] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3198.605274] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 3198.605274] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3198.605274] [ 3198.628389] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3198.676086] Lustre: 257114:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3198.701306] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3198.703053] Lustre: Skipped 1 previous similar message [ 3198.738469] Lustre: lustre-MDT0001: new disk, initializing [ 3198.779991] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3198.782889] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3200.084653] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3204.355403] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3204.470499] Lustre: lustre-OST0000: new disk, initializing [ 3204.473054] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3204.476707] Lustre: 258698:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3205.694688] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3205.699391] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3205.739035] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3206.641188] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3211.292235] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3211.370890] Lustre: lustre-OST0001: new disk, initializing [ 3211.373649] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3211.377286] Lustre: 259569:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3213.265982] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3213.269496] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3213.317463] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3213.856287] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3222.117150] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 09:38:19 (1788356299) [ 3232.389809] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 09:38:29 (1788356309) [ 3246.573865] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3246.589720] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3246.600858] Lustre: Skipped 2 previous similar messages [ 3246.606047] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3252.385398] Lustre: server umount lustre-OST0000 complete [ 3257.314573] LustreError: 258682:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3257.334096] LustreError: 258682:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3262.148756] Lustre: server umount lustre-MDT0000 complete [ 3266.828714] LustreError: 258697:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356346 with bad export cookie 14241930418684755786 [ 3266.836367] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3266.840867] LustreError: 258697:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3267.574696] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3267.593335] Lustre: Skipped 4 previous similar messages [ 3281.376689] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3281.602853] Lustre: server umount lustre-MDT0001 complete [ 3288.608908] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 3300.724385] Lustre: server umount lustre-OST0001 complete [ 3303.667166] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 3312.005993] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3331.004417] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3331.146936] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3331.165390] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3331.210904] Lustre: lustre-MDT0000: new disk, initializing [ 3331.255173] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3331.258830] Lustre: Skipped 3 previous similar messages [ 3331.273629] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3333.501975] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3339.503097] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3339.564839] Lustre: 264098:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3339.728232] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3341.753163] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3346.902670] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3349.574945] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3352.777324] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3352.921326] Lustre: lustre-OST0000: new disk, initializing [ 3352.922913] Lustre: Skipped 1 previous similar message [ 3352.924826] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3352.926653] Lustre: Skipped 2 previous similar messages [ 3352.928608] Lustre: 266067:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3354.135363] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3354.143317] Lustre: Skipped 1 previous similar message [ 3354.147944] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3354.188955] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3355.614329] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3360.921095] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3364.322502] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3364.323499] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3364.326400] LustreError: Skipped 2 previous similar messages [ 3364.327125] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3364.337856] Lustre: Skipped 1 previous similar message [ 3364.339276] Lustre: Skipped 10 previous similar messages [ 3370.423119] Lustre: server umount lustre-OST0000 complete [ 3378.517541] Lustre: server umount lustre-MDT0000 complete [ 3380.764859] LustreError: 264902:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356460 with bad export cookie 14241930418684757256 [ 3380.772786] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3380.781168] LustreError: 264902:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3381.026615] Lustre: server umount lustre-MDT0001 complete [ 3386.954612] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 3388.438996] Key type lgssc unregistered [ 3388.598774] LNet: 267830:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3388.607313] LNetError: 267830:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3388.617551] LNet: Removed LNI 192.168.203.122@tcp [ 3389.132141] Key type .llcrypt unregistered [ 3389.134641] Key type ._llcrypt unregistered [ 3404.109810] Key type ._llcrypt registered [ 3404.112655] Key type .llcrypt registered [ 3404.181744] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3404.762749] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3404.776694] alg: No test for adler32 (adler32-zlib) [ 3405.712148] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 3405.842205] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 3407.464434] Key type lgssc registered [ 3408.155368] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3412.495203] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3412.506430] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3413.752290] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3416.044548] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3420.860609] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3421.107330] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3423.385807] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3427.189710] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3429.927741] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3433.425452] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3433.628558] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3436.910923] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3438.767695] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3441.348632] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3441.937372] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 3444.196508] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3444.201344] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3444.210039] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3445.100934] Lustre: server umount lustre-OST0000 complete [ 3447.259850] Lustre: server umount lustre-MDT0000 complete [ 3449.322859] LustreError: 269253:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356528 with bad export cookie 15421531023339462198 [ 3449.326529] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3449.334126] LustreError: 269253:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3455.605655] Lustre: server umount lustre-MDT0001 complete [ 3461.546698] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 3463.329233] Key type lgssc unregistered [ 3463.537270] LNet: 272857:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3463.545311] LNetError: 272857:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3463.560497] LNet: Removed LNI 192.168.203.122@tcp [ 3464.039540] Key type .llcrypt unregistered [ 3464.042126] Key type ._llcrypt unregistered [ 3474.261441] Key type ._llcrypt registered [ 3474.264476] Key type .llcrypt registered [ 3474.334979] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3474.827150] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3474.909233] alg: No test for adler32 (adler32-zlib) [ 3475.843556] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 3475.978816] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 3477.600267] Key type lgssc registered [ 3478.254090] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3483.407714] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3483.418794] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3498.912313] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3504.032327] LustreError: 274028:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.122@tcp: failed processing log, type 4: rc = -110 [ 3530.656276] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3533.947462] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3537.854353] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3539.131651] Lustre: server umount lustre-OST0000 complete [ 3547.215170] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 3548.706461] Key type lgssc unregistered [ 3548.885485] LNet: 275656:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3548.888860] LNetError: 275656:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3548.905062] LNet: Removed LNI 192.168.203.122@tcp [ 3549.350326] Key type .llcrypt unregistered [ 3549.352083] Key type ._llcrypt unregistered [ 3568.908685] Key type ._llcrypt registered [ 3568.910970] Key type .llcrypt registered [ 3568.976400] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3569.480237] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3569.501456] alg: No test for adler32 (adler32-zlib) [ 3570.425922] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 3570.558903] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 3572.160304] Key type lgssc registered [ 3572.754693] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3579.047457] loop0: detected capacity change from 0 to 204800000 [ 3579.163071] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3579.170194] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3579.322341] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3579.791358] loop0: detected capacity change from 0 to 204800000 [ 3579.870428] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3579.874375] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3580.032629] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3580.482809] loop0: detected capacity change from 0 to 204800000 [ 3580.545226] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3580.553000] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3580.604814] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3581.059746] loop0: detected capacity change from 0 to 204800000 [ 3581.124765] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3581.600908] loop0: detected capacity change from 0 to 204800000 [ 3581.611288] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3583.296094] loop0: detected capacity change from 0 to 204800000 [ 3583.310560] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3585.023696] loop0: detected capacity change from 0 to 204800000 [ 3585.040180] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3586.820243] loop0: detected capacity change from 0 to 204800000 [ 3586.837465] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3588.759522] loop0: detected capacity change from 0 to 204800000 [ 3588.794116] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3588.816626] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3588.853980] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3588.859847] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 3588.866473] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 3588.870729] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 3588.874690] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 3588.879806] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 3588.885684] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 3588.892510] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 3588.898234] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 3588.903667] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 3588.911389] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 3588.921116] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 3588.928719] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 3588.934767] Lustre: 279044:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 3592.075139] Lustre: server umount MGS complete [ 3592.492619] loop0: detected capacity change from 0 to 204800000 [ 3592.526463] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3592.714391] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3592.740586] Lustre: lustre-MDT0000: Aborting client recovery [ 3593.143341] loop1: detected capacity change from 0 to 204800000 [ 3593.195867] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3593.243342] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3593.248190] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 3593.255180] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 3593.264821] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 3593.270664] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 3593.276451] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 3593.281331] Lustre: 279477:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 3593.291310] Lustre: Found index 1 for lustre-MDT0001, updating log [ 3593.367725] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3593.391850] Lustre: lustre-MDT0001: Aborting client recovery [ 3593.814325] loop2: detected capacity change from 0 to 204800000 [ 3593.864916] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3593.905125] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3593.914320] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 3593.921887] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 3593.932451] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 3593.936663] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 3593.942720] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 3593.948860] Lustre: 279558:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 3594.009318] Lustre: Found index 0 for lustre-OST0000, updating log [ 3594.030832] Lustre: 279577:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3594.076959] Lustre: lustre-OST0000: Aborting recovery [ 3594.477861] loop3: detected capacity change from 0 to 204800000 [ 3594.520142] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3594.554463] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3594.560076] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 3594.567379] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 3594.572830] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 3594.579121] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 3594.585097] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 3594.590812] Lustre: 279641:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 3594.615808] Lustre: 279646:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3594.646083] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3594.650187] Lustre: Skipped 1 previous similar message [ 3594.662868] Lustre: lustre-OST0001: Aborting recovery [ 3599.859834] LustreError: 279421:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 3602.916210] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 3602.918400] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 3602.919157] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 3602.922437] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 3602.934635] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 3602.946022] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 3606.775733] LustreError: 279388:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 468us: rc = -2 [ 3618.273039] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3618.273305] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3618.276541] Lustre: Skipped 2 previous similar messages [ 3618.280479] Lustre: Skipped 3 previous similar messages [ 3623.393953] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3623.397509] Lustre: Skipped 3 previous similar messages [ 3624.441115] Lustre: server umount lustre-MDT0000 complete [ 3624.925440] LustreError: 279372:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356704 with bad export cookie 11060596455214803824 [ 3624.926396] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3624.929967] LustreError: 279372:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3628.514355] LustreError: 279387:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3628.514378] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3628.518052] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3628.525509] LustreError: 279387:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 3628.533536] Lustre: Skipped 2 previous similar messages [ 3629.537293] LustreError: 279385:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3629.545577] LustreError: 279385:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3634.658729] LustreError: 279878:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3634.658833] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3634.666135] LustreError: 279878:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3634.668708] Lustre: Skipped 4 previous similar messages [ 3639.264274] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3639.407896] Lustre: server umount lustre-MDT0001 complete [ 3654.112196] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3654.156919] Lustre: server umount lustre-OST0000 complete [ 3660.661205] Lustre: server umount lustre-OST0001 complete [ 3664.479944] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 09:45:42 (1788356742) [ 3676.621691] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 3680.839659] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3696.439312] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3696.552479] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3696.567866] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3696.609682] Lustre: lustre-MDT0000: new disk, initializing [ 3696.643320] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3696.654470] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3698.367245] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3703.579167] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3703.646857] Lustre: 283709:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3703.689307] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3703.691889] Lustre: Skipped 1 previous similar message [ 3703.730638] Lustre: lustre-MDT0001: new disk, initializing [ 3703.779921] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3703.800071] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3703.807530] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3705.839633] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3710.658632] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3713.305534] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3716.425796] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3716.553699] Lustre: lustre-OST0000: new disk, initializing [ 3716.556402] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3716.559835] Lustre: 285673:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3716.599655] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3719.181942] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3723.476297] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3725.320431] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3725.324560] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3725.359084] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3731.345994] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 3733.066508] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 3742.179714] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 3746.781327] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 3786.720921] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3786.721527] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3786.724435] LustreError: Skipped 1 previous similar message [ 3786.730719] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3786.735699] Lustre: Skipped 1 previous similar message [ 3792.290814] Lustre: server umount lustre-OST0000 complete [ 3794.914489] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3794.915735] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3794.921895] Lustre: Skipped 2 previous similar messages [ 3794.928248] Lustre: Skipped 3 previous similar messages [ 3808.224152] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3808.313296] Lustre: server umount lustre-MDT0000 complete [ 3809.982581] LustreError: 283703:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356889 with bad export cookie 11060596455214806526 [ 3809.986341] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3809.988950] LustreError: 283703:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3810.138774] Lustre: server umount lustre-MDT0001 complete [ 3813.674767] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3815.429306] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3817.490650] Lustre: server umount MGS complete [ 3822.079603] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3822.259168] LustreError: 289530:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3822.266664] LustreError: 289543:0:(qmt_pool.c:1854:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 3822.295936] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3823.842414] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3827.201062] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3828.932385] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3831.930379] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3834.293493] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3837.113124] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3839.797263] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3842.866262] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3873.250353] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3873.254418] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3873.256881] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3873.263797] Lustre: Skipped 1 previous similar message [ 3873.266426] Lustre: Skipped 4 previous similar messages [ 3877.486975] Lustre: server umount lustre-OST0000 complete [ 3883.489794] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3883.499846] Lustre: Skipped 1 previous similar message [ 3885.503877] Lustre: server umount lustre-MDT0000 complete [ 3887.270679] LustreError: 292255:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788356966 with bad export cookie 11060596455214808290 [ 3887.275622] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3887.279282] LustreError: 292255:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3887.428382] Lustre: server umount lustre-MDT0001 complete [ 3891.933283] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 3893.316914] Key type lgssc unregistered [ 3893.484551] LNet: 293470:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3893.491188] LNetError: 293470:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3893.500561] LNet: Removed LNI 192.168.203.122@tcp [ 3893.911374] Key type .llcrypt unregistered [ 3893.913254] Key type ._llcrypt unregistered [ 3909.769379] Key type ._llcrypt registered [ 3909.771097] Key type .llcrypt registered [ 3909.827845] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 3917.129777] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 3917.628939] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3917.638936] alg: No test for adler32 (adler32-zlib) [ 3918.532042] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 3918.656910] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 3920.248156] Key type lgssc registered [ 3920.772911] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3935.299148] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3935.310220] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3936.419192] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3936.440868] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3936.507754] Lustre: lustre-MDT0000: new disk, initializing [ 3936.541193] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3936.551146] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3938.438941] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3943.392684] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3943.443995] Lustre: 297400:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3943.480325] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3943.480742] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 3943.482434] Lustre: Skipped 1 previous similar message [ 3943.522801] Lustre: lustre-MDT0001: new disk, initializing [ 3943.562593] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3943.577393] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3943.581494] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3945.143139] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3949.424848] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3951.576978] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3954.281214] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3954.406691] Lustre: lustre-OST0000: new disk, initializing [ 3954.409264] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3954.413137] Lustre: 299372:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3954.446717] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3956.807935] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 3959.804088] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3959.809129] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3959.854020] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3961.365116] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3966.148952] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 3972.402357] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 3980.585156] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 3989.542867] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 4031.459044] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4031.460262] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4031.461281] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4031.464996] Lustre: Skipped 1 previous similar message [ 4036.577523] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4036.581090] Lustre: Skipped 2 previous similar messages [ 4041.697815] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4041.701632] Lustre: Skipped 1 previous similar message [ 4044.256080] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4044.325771] Lustre: server umount lustre-OST0000 complete [ 4046.304987] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4046.307723] LustreError: Skipped 1 previous similar message [ 4046.309322] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4046.314983] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4057.057838] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4057.063082] Lustre: Skipped 4 previous similar messages [ 4060.128188] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4060.193990] Lustre: server umount lustre-MDT0000 complete [ 4061.589242] LustreError: 297393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357140 with bad export cookie 7333620154711720723 [ 4061.593615] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4061.594205] LustreError: 297393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4061.717584] Lustre: server umount lustre-MDT0001 complete [ 4064.922786] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4066.550773] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4068.325642] Lustre: server umount MGS complete [ 4072.569835] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4072.771560] LustreError: 303350:0:(qmt_pool.c:1854:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4072.795988] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4074.291607] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4077.728143] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4077.917784] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4079.619677] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4082.506176] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4084.586105] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4087.132734] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4087.284811] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4089.592132] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4092.526694] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4124.130903] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4124.131485] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4124.133808] LustreError: Skipped 1 previous similar message [ 4124.134948] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4124.142614] Lustre: Skipped 2 previous similar messages [ 4124.149147] Lustre: Skipped 1 previous similar message [ 4126.561401] Lustre: server umount lustre-OST0000 complete [ 4129.250913] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4129.251211] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4134.177494] Lustre: server umount lustre-MDT0000 complete [ 4134.369967] LustreError: 303338:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4134.377308] LustreError: 303338:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 4135.497328] LustreError: 306086:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357214 with bad export cookie 7333620154711722662 [ 4135.500865] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4135.502577] LustreError: 306086:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4135.632843] Lustre: server umount lustre-MDT0001 complete [ 4139.673794] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 4140.821111] Key type lgssc unregistered [ 4140.964511] LNet: 307300:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4140.968265] LNetError: 307300:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4140.976580] LNet: Removed LNI 192.168.203.122@tcp [ 4141.302422] Key type .llcrypt unregistered [ 4141.304054] Key type ._llcrypt unregistered [ 4149.271253] Key type ._llcrypt registered [ 4149.272970] Key type .llcrypt registered [ 4149.317275] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 4156.095929] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4156.514990] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4156.557976] alg: No test for adler32 (adler32-zlib) [ 4157.433262] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 4157.528747] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 4159.112143] Key type lgssc registered [ 4159.545713] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4169.176043] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4174.896983] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4174.904597] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4176.006047] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4176.019876] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4176.057560] Lustre: lustre-MDT0000: new disk, initializing [ 4176.087380] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4176.097357] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4177.738383] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4182.781489] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4182.906088] Lustre: lustre-OST0000: new disk, initializing [ 4182.907880] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4182.910426] Lustre: Skipped 1 previous similar message [ 4182.913171] Lustre: 311320:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4182.941990] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4185.262104] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4187.664085] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4187.670738] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4187.684859] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4458.978115] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4458.983224] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4464.097531] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4464.781450] Lustre: server umount lustre-MDT0000 complete [ 4466.116347] LustreError: 310509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357545 with bad export cookie 3624509189451410545 [ 4466.118944] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4466.124612] LustreError: 310509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4466.200838] Lustre: server umount lustre-OST0000 complete [ 4476.578220] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 4480.827282] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4495.381238] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4495.478924] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4495.510354] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4495.545941] Lustre: lustre-MDT0000: new disk, initializing [ 4495.571628] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4495.579528] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4497.233649] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4502.227380] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4502.278774] Lustre: 315562:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4502.309953] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4502.313047] Lustre: Skipped 1 previous similar message [ 4502.361277] Lustre: lustre-MDT0001: new disk, initializing [ 4502.408215] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4502.422068] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4502.427764] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4504.025922] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4508.270918] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4510.548472] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4513.371266] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4513.494257] Lustre: lustre-OST0000: new disk, initializing [ 4513.496738] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4513.500974] Lustre: 317530:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4513.543971] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4516.043298] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4519.940167] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4519.946157] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4519.979661] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4520.461918] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4522.407522] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4522.522850] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4524.374766] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4524.483707] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4530.147223] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4530.148248] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4530.150871] LustreError: Skipped 1 previous similar message [ 4530.157262] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4530.161455] Lustre: Skipped 1 previous similar message [ 4531.424456] Lustre: server umount lustre-OST0000 complete [ 4533.217254] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4533.221182] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4533.227090] Lustre: Skipped 1 previous similar message [ 4533.229809] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4535.266090] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4539.177307] Lustre: server umount lustre-MDT0000 complete [ 4540.752782] LustreError: 315555:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357620 with bad export cookie 3624509189454351343 [ 4540.756537] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4540.758407] LustreError: 315555:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4540.900145] Lustre: server umount lustre-MDT0001 complete [ 4542.327115] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 4543.007423] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 10:00:20 (1788357620) [ 4545.844833] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4546.090419] LustreError: 319839:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4546.100964] LustreError: 319839:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 4546.135549] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4547.867328] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4551.138739] LustreError: 319840:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4551.219455] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4553.006850] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4555.994456] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4558.182815] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4561.231695] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4564.271313] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4567.355678] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4570.070901] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4570.151972] Lustre: lustre-OST0001: new disk, initializing [ 4570.154467] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4570.158181] Lustre: 322674:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4570.198812] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4570.201576] Lustre: Skipped 2 previous similar messages [ 4570.823037] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4570.828669] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4570.850390] LustreError: 322765:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4570.855333] LustreError: 322765:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4571.883882] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4571.889502] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4572.497841] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4572.901262] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4572.903986] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4574.949335] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4574.955717] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 4576.941808] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4577.036288] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4579.043952] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4579.047972] LustreError: 322775:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 4579.136087] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9148c93ac800.ost_server_uuid 50 [ 4579.759909] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9148c93ac800.ost_server_uuid in FULL state after 0 sec [ 4581.894549] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9148c93ac800.ost_server_uuid 50 [ 4582.523619] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9148c93ac800.ost_server_uuid in FULL state after 0 sec [ 4583.151354] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4595.970803] Lustre: lustre-OST0001: Not available for connect from 192.168.203.22@tcp (stopping) [ 4595.975191] Lustre: Skipped 2 previous similar messages [ 4597.738579] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4597.743508] Lustre: Skipped 1 previous similar message [ 4600.642761] Lustre: server umount lustre-OST0001 complete [ 4601.082340] LustreError: 322776:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.22@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4602.849949] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4607.972023] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4607.974495] Lustre: Skipped 5 previous similar messages [ 4607.974640] LustreError: 321657:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4607.981542] LustreError: 321657:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 4608.472092] Lustre: server umount lustre-OST0000 complete [ 4613.090488] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4613.090915] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4613.095115] Lustre: Skipped 3 previous similar messages [ 4624.352226] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4624.414038] Lustre: server umount lustre-MDT0000 complete [ 4625.752144] LustreError: 319821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357705 with bad export cookie 3624509189454352204 [ 4625.754369] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4625.756328] LustreError: 319821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4625.879683] Lustre: server umount lustre-MDT0001 complete [ 4630.134439] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 4631.313863] Key type lgssc unregistered [ 4631.454931] LNet: 325368:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4631.458280] LNetError: 325368:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4631.466509] LNet: Removed LNI 192.168.203.122@tcp [ 4631.828807] Key type .llcrypt unregistered [ 4631.830495] Key type ._llcrypt unregistered [ 4642.250465] Key type ._llcrypt registered [ 4642.252019] Key type .llcrypt registered [ 4642.293792] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4642.675841] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4642.719729] alg: No test for adler32 (adler32-zlib) [ 4643.583835] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 4643.686706] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 4645.280217] Key type lgssc registered [ 4645.724366] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4648.822225] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4648.830085] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4650.022340] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4651.562802] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4654.283728] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4656.868287] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4657.049359] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4658.674180] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4662.397367] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4662.569120] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4664.933070] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4666.662413] LustreError: 328446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4666.673754] LustreError: 328446:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4667.896413] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4670.588988] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4670.677415] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4673.139761] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4674.797028] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 4674.799598] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 4676.197188] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4679.054685] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 4679.139995] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4760.035234] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4760.038457] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4760.039629] Lustre: Skipped 1 previous similar message [ 4763.712508] Lustre: server umount lustre-OST0001 complete [ 4765.156774] LustreError: 328447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4765.163767] LustreError: 328447:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4767.201361] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4767.205511] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4767.211509] Lustre: Skipped 1 previous similar message [ 4767.214129] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4769.249874] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4769.253323] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4769.258987] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4770.274218] LustreError: 329022:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4770.282625] LustreError: 329022:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4771.601136] Lustre: server umount lustre-OST0000 complete [ 4774.881475] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4774.885059] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4774.889697] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4774.892034] Lustre: Skipped 2 previous similar messages [ 4780.513804] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4780.516061] Lustre: Skipped 3 previous similar messages [ 4787.168128] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4787.243805] Lustre: server umount lustre-MDT0000 complete [ 4788.624473] LustreError: 330446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357867 with bad export cookie 1130031022018460660 [ 4788.630123] LustreError: 330446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4788.632073] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4788.766908] Lustre: server umount lustre-MDT0001 complete [ 4792.698204] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 4793.837526] Key type lgssc unregistered [ 4793.989078] LNet: 331702:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4793.994760] LNetError: 331702:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4794.007495] LNet: Removed LNI 192.168.203.122@tcp [ 4794.357309] Key type .llcrypt unregistered [ 4794.359099] Key type ._llcrypt unregistered [ 4812.898048] Key type ._llcrypt registered [ 4812.899037] Key type .llcrypt registered [ 4812.937410] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4813.322668] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4813.380897] alg: No test for adler32 (adler32-zlib) [ 4814.240298] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 4814.343075] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 4815.920139] Key type lgssc registered [ 4816.264209] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4819.392045] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4819.400672] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4820.602059] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4821.991489] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4825.142921] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4825.309131] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4826.843791] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4827.965653] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4830.313697] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4830.435196] LustreError: 335459:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4830.443671] LustreError: 335459:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4830.469540] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4832.587103] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4835.622909] LustreError: 335459:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4835.628663] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 4835.632793] LustreError: 335459:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4835.654931] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4835.754668] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4837.987563] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4840.942690] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 4842.309717] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4846.074684] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 4851.173195] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4851.173508] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4851.174364] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4851.178632] Lustre: Skipped 2 previous similar messages [ 4855.974934] Lustre: server umount lustre-MDT0000 complete [ 4856.291952] LustreError: 333974:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4856.298407] LustreError: 333974:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 4857.302099] LustreError: 333956:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357936 with bad export cookie 520651212306775299 [ 4857.305947] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4857.307918] LustreError: 333956:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4857.435036] Lustre: server umount lustre-MDT0001 complete [ 4869.636883] Lustre: server umount lustre-OST0000 complete [ 4881.181325] Lustre: server umount lustre-OST0001 complete [ 4886.729424] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4890.151580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4890.276228] LustreError: 339229:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4890.292665] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4891.649375] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4894.501594] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4895.924155] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4896.867068] Lustre: 340369:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4899.020140] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4899.143849] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4899.146939] Lustre: Skipped 1 previous similar message [ 4900.198974] LustreError: 340722:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4900.201651] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 4901.069822] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4903.840966] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4905.000944] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 4905.824837] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4909.105217] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4910.397679] Lustre: 342237:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4915.172349] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4915.173598] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4915.174279] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4915.174286] Lustre: Skipped 3 previous similar messages [ 4915.176843] Lustre: Skipped 3 previous similar messages [ 4917.591477] Lustre: server umount lustre-MDT0000 complete [ 4918.790200] LustreError: 339972:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788357998 with bad export cookie 520651212306776958 [ 4918.793881] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4918.794381] LustreError: 339972:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4918.911304] Lustre: server umount lustre-MDT0001 complete [ 4930.496520] Lustre: server umount lustre-OST0000 complete [ 4941.918988] Lustre: server umount lustre-OST0001 complete [ 4943.121823] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 4943.625365] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 4944.172308] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 10:07:02 (1788358022) [ 4951.306810] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4954.184194] loop0: detected capacity change from 0 to 1099511627776 [ 4954.350627] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 4954.353174] *** VALIDATE xfs *** [ 4954.357767] XFS (loop0): Mounting V5 Filesystem [ 4954.367696] XFS (loop0): Ending clean mount [ 4954.767289] loop1: detected capacity change from 0 to 18691697672192 [ 4974.884639] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 4977.748088] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 4988.921765] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4988.997972] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4989.008653] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4989.042357] Lustre: lustre-MDT0000: new disk, initializing [ 4989.061531] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4989.063404] Lustre: Skipped 1 previous similar message [ 4989.068971] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4990.375192] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4994.413560] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4994.450771] Lustre: 347350:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4994.475873] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4994.478545] Lustre: Skipped 1 previous similar message [ 4994.516296] Lustre: lustre-MDT0001: new disk, initializing [ 4994.557361] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4994.560633] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4995.860572] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 4999.441849] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5001.164596] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5003.385793] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5003.518504] Lustre: lustre-OST0000: new disk, initializing [ 5003.520086] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5003.523289] Lustre: 349317:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5005.246529] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5005.250908] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5005.283898] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5005.427457] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5008.975776] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5010.332834] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5010.400868] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5011.721604] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 5011.783689] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5015.522452] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5015.522947] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5015.524858] LustreError: Skipped 1 previous similar message [ 5015.525465] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5015.530809] Lustre: Skipped 1 previous similar message [ 5015.532071] Lustre: Skipped 3 previous similar messages [ 5018.444245] Lustre: server umount lustre-OST0000 complete [ 5020.128923] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5020.132265] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5020.137791] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5020.139522] Lustre: Skipped 1 previous similar message [ 5025.761718] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5025.764069] Lustre: Skipped 2 previous similar messages [ 5025.826759] Lustre: server umount lustre-MDT0000 complete [ 5026.976096] LustreError: 347342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788358106 with bad export cookie 520651212306778484 [ 5026.978554] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5026.979241] LustreError: 347342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5027.089470] Lustre: server umount lustre-MDT0001 complete [ 5029.734732] XFS (loop0): Unmounting Filesystem [ 5031.245683] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 10:08:29 (1788358109) [ 5033.408596] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5033.551102] LustreError: 351871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5033.572903] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5033.574860] Lustre: Skipped 2 previous similar messages [ 5034.793907] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5037.480389] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5038.886540] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5041.070559] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5042.703363] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5044.797052] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5046.802288] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5049.262338] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5064.676562] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5064.677962] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5064.681172] Lustre: Skipped 1 previous similar message [ 5064.682256] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5064.688118] Lustre: Skipped 1 previous similar message [ 5068.887419] Lustre: server umount lustre-OST0000 complete [ 5073.376900] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5073.379629] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5073.384602] Lustre: Skipped 1 previous similar message [ 5076.309924] Lustre: server umount lustre-MDT0000 complete [ 5077.505220] LustreError: 351851:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788358156 with bad export cookie 520651212306779373 [ 5077.508793] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5077.508926] LustreError: 351851:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5077.629425] Lustre: server umount lustre-MDT0001 complete [ 5081.241056] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 5082.242743] Key type lgssc unregistered [ 5082.376384] LNet: 355520:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5082.378669] LNetError: 355520:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5082.386240] LNet: Removed LNI 192.168.203.122@tcp [ 5082.669111] Key type .llcrypt unregistered [ 5082.670422] Key type ._llcrypt unregistered [ 5092.527496] Key type ._llcrypt registered [ 5092.528824] Key type .llcrypt registered [ 5092.572677] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 5093.015881] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5093.079809] alg: No test for adler32 (adler32-zlib) [ 5093.949861] Lustre: Lustre: Build Version: 2.17.55_23_g2958cf4 [ 5094.048917] LNet: Added LNI 192.168.203.122@tcp [8/256/0/180] [ 5095.632199] Key type lgssc registered [ 5096.064753] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5098.755110] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5098.760926] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5099.900348] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5101.251608] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5104.120342] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5104.238410] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5105.644087] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5108.120087] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5110.086909] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5112.354931] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5112.479979] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5114.478066] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5116.955505] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5130.208985] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5130.211987] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5130.216343] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5131.235402] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5131.236088] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5132.544570] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.22@tcp (stopping) [ 5132.547148] Lustre: Skipped 1 previous similar message [ 5136.086650] Lustre: server umount lustre-MDT0001 complete [ 5136.354930] LustreError: 357062:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5136.360524] LustreError: 357062:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5137.657025] LustreError: 357058:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.22@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5139.782339] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5139.811155] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5139.813177] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5139.823331] Lustre: 357050:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5139.918924] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5141.157674] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5145.062418] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5145.574113] LustreError: 360792:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5145.576715] LustreError: 360792:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5145.579064] LustreError: 357055:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5145.595256] LustreError: 360795:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.122@tcp: cfg command failed: rc = -17 [ 5145.598238] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 5145.598238] [ 5447.141195] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5447.141855] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5447.165557] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5452.258948] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5452.263921] Lustre: Skipped 3 previous similar messages [ 5452.776816] Lustre: server umount lustre-MDT0001 complete [ 5455.105925] LustreError: 357057:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.22@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5457.382300] LustreError: 358496:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5457.406683] LustreError: 358496:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5462.503843] LustreError: 357063:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5462.518092] LustreError: 357063:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5464.840173] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5465.067527] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5465.077472] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5465.141874] Lustre: 357051:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5465.525958] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5470.714168] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5472.608776] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5472.759959] LustreError: 372561:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5472.767150] LustreError: 372561:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5472.779091] LustreError: 357055:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5472.793545] LustreError: 357055:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5472.904509] LustreError: 372571:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 5472.941732] LustreError: 372571:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 5472.953970] LustreError: 372571:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.122@tcp: cfg command failed: rc = -17 [ 5472.962960] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.122@tcp [ 5472.962960] [ 5475.303090] hrtimer: interrupt took 5081762 ns [ 5777.677649] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.22@tcp (stopping) [ 5777.890333] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5777.894681] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5777.905148] Lustre: Skipped 2 previous similar messages [ 5783.761640] Lustre: server umount lustre-MDT0001 complete [ 5787.899650] LustreError: 357058:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.22@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5789.710822] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5789.778607] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5789.784649] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5789.808280] Lustre: 357053:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5789.997613] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 5792.250436] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 5795.309186] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5798.380749] LustreError: 383793:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5798.385351] LustreError: 383793:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5798.389186] LustreError: 357055:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5798.395596] LustreError: 357055:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5798.431581] LustreError: 383796:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 5798.443537] LustreError: 383796:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.122@tcp: cfg command failed: rc = -114 [ 5798.450725] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 5798.450725] [ 6112.741204] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6112.763269] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6112.764384] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6112.787780] Lustre: Skipped 7 previous similar messages [ 6118.379326] Lustre: server umount lustre-MDT0000 complete [ 6121.889952] LustreError: 357044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359201 with bad export cookie 11731332384356353111 [ 6121.902041] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6121.909886] LustreError: 357044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6122.981687] LustreError: 357058:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6122.983449] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6123.003809] LustreError: 357058:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6123.032349] Lustre: Skipped 2 previous similar messages [ 6136.288722] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6136.621785] Lustre: server umount lustre-MDT0001 complete [ 6140.730773] Lustre: server umount lustre-OST0000 complete [ 6151.170058] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 6161.940607] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 6200.371667] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 10:27:57 (1788359277) [ 6207.590929] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6207.851657] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6207.883079] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6207.992883] Lustre: lustre-MDT0000: new disk, initializing [ 6208.051463] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6208.062690] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6212.615790] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 6223.053193] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6223.171774] Lustre: 394462:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6223.252798] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6223.257366] Lustre: Skipped 1 previous similar message [ 6223.269877] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 6223.283637] Lustre: Skipped 6 previous similar messages [ 6223.340303] Lustre: lustre-MDT0001: new disk, initializing [ 6223.457081] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6223.500083] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6223.517330] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6228.189452] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 6237.330041] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6243.541640] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6250.190276] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6250.482459] Lustre: lustre-OST0000: new disk, initializing [ 6250.486789] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6250.505826] Lustre: 396430:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6250.615602] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6256.204119] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6256.228533] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6256.384356] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6256.647679] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug -1 all [ 6266.842425] Lustre: DEBUG MARKER: oleg322-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6274.530447] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6274.549443] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6276.475904] Lustre: server umount lustre-MDT0000 complete [ 6277.094671] LustreError: 394474:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6277.116277] LustreError: 394474:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 6279.994610] LustreError: 395274:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 6279.994836] LustreError: 394454:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359359 with bad export cookie 11731332384356355050 [ 6279.997362] LustreError: MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6280.021561] LustreError: 394454:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6280.405285] Lustre: server umount lustre-MDT0001 complete [ 6294.638298] Lustre: server umount lustre-OST0000 complete [ 6319.279428] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing set_hostid [ 6327.665227] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local [ 6351.930663] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 6222 sec ========== 10:30:29 (1788359429) [ 6353.349694] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 10:30:30 (1788359430) === [ 6355.962992] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 10:30:33 (1788359433) === [ 6386.529184] Lustre: DEBUG MARKER: oleg322-server.virtnet: executing unload_modules_local [ 6388.747655] Key type lgssc unregistered [ 6388.995613] LNet: 402793:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6389.008651] LNetError: 402793:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6389.037568] LNet: Removed LNI 192.168.203.122@tcp [ 6389.812796] Key type .llcrypt unregistered [ 6389.817434] Key type ._llcrypt unregistered