[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 517283912 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002325] x2apic enabled [ 0.003007] Switched APIC routing to physical x2apic. [ 0.004015] kvm-guest: setup PV IPIs [ 0.007489] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008024] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009011] pid_max: default: 32768 minimum: 301 [ 0.010111] LSM: Security Framework initializing [ 0.011052] Yama: becoming mindful. [ 0.012033] SELinux: Initializing. [ 0.013045] *** VALIDATE selinux *** [ 0.021399] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025729] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026151] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028018] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030098] *** VALIDATE tmpfs *** [ 0.031424] *** VALIDATE proc *** [ 0.033272] *** VALIDATE cgroup *** [ 0.034011] *** VALIDATE cgroup2 *** [ 0.035284] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037096] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.039005] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.040032] Spectre V2 : User space: Vulnerable [ 0.041013] Speculative Store Bypass: Vulnerable [ 0.044262] debug: unmapping init [mem 0xffffffff85259000-0xffffffff85260fff] [ 0.047182] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.048766] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.049026] ... version: 2 [ 0.050014] ... bit width: 48 [ 0.051013] ... generic registers: 4 [ 0.052014] ... value mask: 0000ffffffffffff [ 0.053021] ... max period: 00007fffffffffff [ 0.054018] ... fixed-purpose events: 3 [ 0.055017] ... event mask: 000000070000000f [ 0.056349] rcu: Hierarchical SRCU implementation. [ 0.058554] smp: Bringing up secondary CPUs ... [ 0.059626] x86: Booting SMP configuration: [ 0.060033] .... node #0, CPUs: #1 #2 #3 [ 0.066307] smp: Brought up 1 node, 4 CPUs [ 0.068018] smpboot: Max logical packages: 1 [ 0.068949] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.122506] node 0 deferred pages initialised in 52ms [ 0.125540] devtmpfs: initialized [ 0.126223] x86/mm: Memory block size: 128MB [ 0.128494] gcov: version magic: 0x41383552 [ 0.131330] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.136133] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.138345] pinctrl core: initialized pinctrl subsystem [ 0.140160] [ 0.140653] ************************************************************* [ 0.143013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.145011] ** ** [ 0.147013] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.149013] ** ** [ 0.151013] ** This means that this kernel is built to expose internal ** [ 0.153013] ** IOMMU data structures, which may compromise security on ** [ 0.156013] ** your system. ** [ 0.157011] ** ** [ 0.159015] ** If you see this message and you are not debugging the ** [ 0.161018] ** kernel, report this immediately to your vendor! ** [ 0.163012] ** ** [ 0.165013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.167014] ************************************************************* [ 0.169962] NET: Registered protocol family 16 [ 0.172491] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.176065] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.178064] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.182687] cpuidle: using governor menu [ 0.183695] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.186421] PCI: Using configuration type 1 for base access [ 0.188143] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.197272] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.200025] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.202244] cryptd: max_cpu_qlen set to 1000 [ 0.205276] ACPI: Added _OSI(Module Device) [ 0.206013] ACPI: Added _OSI(Processor Device) [ 0.208015] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.209013] ACPI: Added _OSI(Processor Aggregator Device) [ 0.213389] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.220149] ACPI: Interpreter enabled [ 0.221056] ACPI: PM: (supports S0 S3 S4 S5) [ 0.222011] ACPI: Using IOAPIC for interrupt routing [ 0.224108] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.226376] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.237790] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.240052] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.243021] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.247097] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.252156] acpiphp: Slot [2] registered [ 0.254190] acpiphp: Slot [5] registered [ 0.256134] acpiphp: Slot [6] registered [ 0.257146] acpiphp: Slot [7] registered [ 0.259137] acpiphp: Slot [8] registered [ 0.260137] acpiphp: Slot [9] registered [ 0.262111] acpiphp: Slot [10] registered [ 0.263122] acpiphp: Slot [3] registered [ 0.264189] acpiphp: Slot [4] registered [ 0.266104] acpiphp: Slot [11] registered [ 0.267115] acpiphp: Slot [12] registered [ 0.268122] acpiphp: Slot [13] registered [ 0.270117] acpiphp: Slot [14] registered [ 0.271107] acpiphp: Slot [15] registered [ 0.272114] acpiphp: Slot [16] registered [ 0.274101] acpiphp: Slot [17] registered [ 0.275095] acpiphp: Slot [18] registered [ 0.276183] acpiphp: Slot [19] registered [ 0.278095] acpiphp: Slot [20] registered [ 0.279083] acpiphp: Slot [21] registered [ 0.280145] acpiphp: Slot [22] registered [ 0.282100] acpiphp: Slot [23] registered [ 0.283089] acpiphp: Slot [24] registered [ 0.284088] acpiphp: Slot [25] registered [ 0.286119] acpiphp: Slot [26] registered [ 0.288136] acpiphp: Slot [27] registered [ 0.289113] acpiphp: Slot [28] registered [ 0.291109] acpiphp: Slot [29] registered [ 0.293106] acpiphp: Slot [30] registered [ 0.294101] acpiphp: Slot [31] registered [ 0.296090] PCI host bridge to bus 0000:00 [ 0.297018] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.300032] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.302034] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.304024] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.306024] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.309025] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.310215] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.312987] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.315294] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.325016] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.329625] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.332029] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.334014] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.336019] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.338501] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.342936] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.346047] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.349808] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.356017] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.370015] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.376018] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.381247] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.389018] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.396022] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.412025] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.423846] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.431018] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.438027] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.472019] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.489996] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.504021] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.520026] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.558024] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.577184] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.594021] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.611031] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.634019] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.649730] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.668017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.686022] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.750024] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.774345] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.786020] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.806028] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.833016] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.845749] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.847443] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.851367] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.853458] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.855327] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.861291] iommu: Default domain type: Passthrough [ 0.863674] SCSI subsystem initialized [ 0.865168] ACPI: bus type USB registered [ 0.867110] usbcore: registered new interface driver usbfs [ 0.869101] usbcore: registered new interface driver hub [ 0.872086] usbcore: registered new device driver usb [ 0.873172] pps_core: LinuxPPS API ver. 1 registered [ 0.875016] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.879081] PTP clock support registered [ 0.881151] EDAC MC: Ver: 3.0.0 [ 0.884167] PCI: Using ACPI for IRQ routing [ 0.885970] NetLabel: Initializing [ 0.886012] NetLabel: domain hash size = 128 [ 0.887018] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.888146] NetLabel: unlabeled traffic allowed by default [ 0.890326] vgaarb: loaded [ 0.892255] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.894017] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.900657] clocksource: Switched to clocksource kvm-clock [ 1.012439] VFS: Disk quotas dquot_6.6.0 [ 1.014014] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.017187] *** VALIDATE ramfs *** [ 1.018444] *** VALIDATE hugetlbfs *** [ 1.020627] pnp: PnP ACPI init [ 1.023293] pnp: PnP ACPI: found 6 devices [ 1.040584] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.044056] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.046243] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.048183] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.050880] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.053048] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.055871] NET: Registered protocol family 2 [ 1.059684] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.065115] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.069113] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.074747] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.078094] TCP: Hash tables configured (established 65536 bind 65536) [ 1.081214] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.084271] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.087364] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.090360] NET: Registered protocol family 1 [ 1.092522] RPC: Registered named UNIX socket transport module. [ 1.094660] RPC: Registered udp transport module. [ 1.096247] RPC: Registered tcp transport module. [ 1.098010] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.100490] NET: Registered protocol family 44 [ 1.102313] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.104669] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.106923] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.109470] PCI: CLS 0 bytes, default 64 [ 1.111250] Unpacking initramfs... [ 2.503246] debug: unmapping init [mem 0xffff9e98fcc54000-0xffff9e98fffbffff] [ 2.507283] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.509520] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.512664] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.021961] Initialise system trusted keyrings [ 3.023391] Key type blacklist registered [ 3.024751] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.034366] zbud: loaded [ 3.037466] *** VALIDATE nfs *** [ 3.038850] *** VALIDATE nfs4 *** [ 3.040377] pstore: using deflate compression [ 3.044259] Platform Keyring initialized [ 3.152928] NET: Registered protocol family 38 [ 3.159869] Key type asymmetric registered [ 3.161266] Asymmetric key parser 'x509' registered [ 3.162745] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.164765] io scheduler mq-deadline registered [ 3.166488] io scheduler kyber registered [ 3.167593] io scheduler bfq registered [ 3.169232] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.171781] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.174733] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.177687] ACPI: Power Button [PWRF] [ 3.182919] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.189573] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.201160] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.207543] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.225265] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.254707] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.283021] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.290328] Non-volatile memory driver v1.3 [ 3.291863] Linux agpgart interface v0.103 [ 3.323219] virtio_blk virtio1: [vda] 149760 512-byte logical blocks (76.7 MB/73.1 MiB) [ 3.325808] vda: detected capacity change from 0 to 76677120 [ 3.350033] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.352640] vdb: detected capacity change from 0 to 1073741824 [ 3.370264] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.372802] vdc: detected capacity change from 0 to 2621440000 [ 3.388367] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.390265] vdd: detected capacity change from 0 to 2621440000 [ 3.404562] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.406558] vde: detected capacity change from 0 to 4294967296 [ 3.424785] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.427709] vdf: detected capacity change from 0 to 4294967296 [ 3.441307] libphy: Fixed MDIO Bus: probed [ 3.463268] usbcore: registered new interface driver usbserial_generic [ 3.465557] usbserial: USB Serial support registered for generic [ 3.467822] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.471858] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.473647] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.476091] mousedev: PS/2 mouse device common for all mice [ 3.479434] rtc_cmos 00:05: RTC can wake from S4 [ 3.482117] rtc_cmos 00:05: registered as rtc0 [ 3.483773] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.486757] intel_pstate: CPU model not supported [ 3.488085] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.494640] hid: raw HID events driver (C) Jiri Kosina [ 3.494777] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.496534] usbcore: registered new interface driver usbhid [ 3.499575] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.500893] usbhid: USB HID core driver [ 3.501069] drop_monitor: Initializing network drop monitor service [ 3.507706] Initializing XFRM netlink socket [ 3.509691] NET: Registered protocol family 10 [ 3.512359] Segment Routing with IPv6 [ 3.514142] NET: Registered protocol family 17 [ 3.516309] mpls_gso: MPLS GSO support [ 3.522156] RAS: Correctable Errors collector initialized. [ 3.525523] AVX version of gcm_enc/dec engaged. [ 3.527544] AES CTR mode by8 optimization enabled [ 3.592260] sched_clock: Marking stable (3592232599, 0)->(4525589631, -933357032) [ 3.596441] registered taskstats version 1 [ 3.598993] Loading compiled-in X.509 certificates [ 3.600773] zswap: loaded using pool lzo/zbud [ 3.619426] Key type big_key registered [ 3.631790] Key type encrypted registered [ 3.633086] ima: No TPM chip found, activating TPM-bypass! [ 3.634798] ima: Allocated hash algorithm: sha1 [ 3.636059] ima: No architecture policies found [ 3.637125] evm: Initialising EVM extended attributes: [ 3.638668] evm: security.selinux [ 3.639402] evm: security.ima [ 3.640253] evm: security.capability [ 3.641255] evm: HMAC attrs: 0x1 [ 3.642882] rtc_cmos 00:05: setting system clock to 2026-09-03 12:34:26 UTC (1788438866) [ 3.646634] debug: unmapping init [mem 0xffffffff86203000-0xffffffff863fffff] [ 3.648932] debug: unmapping init [mem 0xffffffff84f82000-0xffffffff85258fff] [ 3.657081] Write protecting the kernel read-only data: 28672k [ 3.659344] debug: unmapping init [mem 0xffffffff83603000-0xffffffff837fffff] [ 3.661202] debug: unmapping init [mem 0xffffffff83f14000-0xffffffff83ffffff] [ 3.686514] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.693713] systemd[1]: Detected virtualization kvm. [ 3.696145] systemd[1]: Detected architecture x86-64. [ 3.698240] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.722761] systemd[1]: No hostname configured. [ 3.724610] systemd[1]: Set hostname to . [ 3.726868] random: systemd: uninitialized urandom read (16 bytes read) [ 3.729451] systemd[1]: Initializing machine ID from random generator. [ 3.775444] random: ln: uninitialized urandom read (6 bytes read) [ 3.853305] random: systemd: uninitialized urandom read (16 bytes read) [ 3.855570] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 3.859234] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 3.862596] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket. Starting Journal Service... Starting Setup Virtual Console... Starting Apply Kernel Variables... Starting Create Volatile Files and Directories... [ OK ] Reached target Initrd Root Device. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.439725] device-mapper: uevent: version 1.0.3 [ 4.442300] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 5.072781] virtio_net virtio0 ens2: renamed from eth0 [ 5.077395] scsi host0: ata_piix [ 5.084676] scsi host1: ata_piix [ 5.087072] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.089105] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 5.097315] random: fast init done [ 9.732294] dracut-initqueue[587]: RTNETLINK answers: File exists [ 10.146427] random: crng init done [ 10.147638] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.600261] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 13.920254] printk: systemd: 24 output lines suppressed due to ratelimiting [ 14.853904] SELinux: Disabled at runtime. [ 15.004353] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 15.020424] systemd[1]: Detected virtualization kvm. [ 15.025418] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 16.620919] systemd[1]: initrd-switch-root.service: Succeeded. [ 16.632325] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 16.649596] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 16.664174] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 16.675218] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 16.691193] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.710782] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on Process Core Dump Socket. Starting Remount Root and Kernel File Systems... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... Activating swap /dev/disk/by-label/SWAP... [ OK ] Stopped target Initrd Root File System. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Mounting Huge Pages File System... [ 17.026862] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-getty.slice. Starting Apply Kernel Variables... Mounting POSIX Message Queue File System... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Huge Pages File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Configure read-only root support... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 18.204611] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 19.521678] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 19.691628] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 20.404742] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 20.665676] EDAC sbridge: Ver: 1.1.2 [ 24.318966] Key type dns_resolver registered [* ] A start job is running for Configur…-only root support (7s / no limit) [** [ 25.060242] NFS: Registering the id_resolver key type [0m] A start job[ 25.062905] Key type id_resolver registered [ 25.068289] Key type id_legacy registered is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Login Service... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... Starting Hostname Service... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg226-server login: [ 94.124388] libcfs: loading out-of-tree module taints kernel. [ 94.182179] Key type ._llcrypt registered [ 94.190465] Key type .llcrypt registered [ 94.357723] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 116.828164] hrtimer: interrupt took 5859070 ns [ 118.488423] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 120.630823] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 120.649943] alg: No test for adler32 (adler32-zlib) [ 122.537573] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 123.890866] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 125.809136] Key type lgssc registered [ 128.698253] Lustre: Echo OBD driver; http://www.lustre.org/ [ 152.693506] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 201.351606] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 218.125371] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 218.173839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 219.633888] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 219.705867] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 219.934748] Lustre: lustre-MDT0000: new disk, initializing [ 220.023107] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 220.055632] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 225.674424] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 243.023162] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 243.294571] Lustre: 6518:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 243.349048] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 243.352641] Lustre: Skipped 1 previous similar message [ 243.442808] Lustre: lustre-MDT0001: new disk, initializing [ 243.574280] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 243.635458] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 243.668768] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 250.244743] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 256.034409] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 267.730124] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 268.064892] Lustre: lustre-OST0000: new disk, initializing [ 268.068336] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 268.074075] Lustre: 8456:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 268.136888] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 273.981207] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 273.990729] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 274.083815] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 275.116362] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 290.883571] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 291.047531] Lustre: lustre-OST0001: new disk, initializing [ 291.051992] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 291.057910] Lustre: 9528:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 291.141452] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 298.053987] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 301.180203] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 301.189735] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 301.277244] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 311.742344] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 323.668470] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 330.876683] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing check_logdir /tmp/testlogs/ [ 335.863524] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing yml_node [ 340.837281] Lustre: DEBUG MARKER: Client: 2.17.58.2 [ 343.225910] Lustre: DEBUG MARKER: MDS: 2.17.58.2 [ 345.625817] Lustre: DEBUG MARKER: OSS: 2.17.58.2 [ 347.628683] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Sep 3 08:40:08 EDT 2026 [ 364.596367] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 366.750592] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 387.041767] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 387.044468] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 387.072524] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 388.585409] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 388.590897] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 388.604423] Lustre: Skipped 1 previous similar message [ 388.617757] Lustre: Skipped 3 previous similar messages [ 391.677936] Lustre: server umount lustre-MDT0000 complete [ 396.591086] LustreError: 10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788439259 with bad export cookie 14287572934232917905 [ 396.591464] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 396.609460] LustreError: 10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 398.832823] LustreError: 6526:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 398.836873] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 398.840359] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 398.855634] LustreError: 6526:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 398.885789] Lustre: Skipped 2 previous similar messages [ 401.825215] LustreError: 6524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 401.827653] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 401.854928] LustreError: 6524:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 401.886559] Lustre: Skipped 2 previous similar messages [ 403.467558] Lustre: server umount lustre-MDT0001 complete [ 408.820265] Lustre: server umount lustre-OST0000 complete [ 413.797262] Lustre: server umount lustre-OST0001 complete [ 422.200373] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 434.955510] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 483.391223] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 483.677991] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 483.727791] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 483.840193] Lustre: lustre-MDT0000: new disk, initializing [ 483.967232] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 484.001982] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 490.932675] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 503.669471] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 503.932065] Lustre: 15087:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 504.021709] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 504.025629] Lustre: Skipped 1 previous similar message [ 504.096807] Lustre: lustre-MDT0001: new disk, initializing [ 504.201956] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 504.271290] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 504.285573] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 509.851697] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 521.813985] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 528.233723] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 535.850391] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 536.297555] Lustre: lustre-OST0000: new disk, initializing [ 536.306261] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 536.319770] Lustre: 17059:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 536.446214] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 537.861438] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 537.874055] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 538.047949] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 543.679734] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 553.671674] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 559.718500] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 560.082199] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 565.465757] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 565.685591] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 568.815035] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 568.834313] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 568.842959] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 568.846219] LustreError: Skipped 1 previous similar message [ 568.862931] Lustre: Skipped 1 previous similar message [ 573.979481] Lustre: server umount lustre-OST0000 complete [ 581.093844] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 581.102877] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 581.123029] Lustre: Skipped 1 previous similar message [ 581.129391] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 585.866874] Lustre: server umount lustre-MDT0000 complete [ 588.258535] LustreError: 15100:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 588.305555] LustreError: 15100:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 591.342351] LustreError: 15885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788439454 with bad export cookie 14287572934232919431 [ 591.344620] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 591.354846] LustreError: 15885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 592.121369] Lustre: server umount lustre-MDT0001 complete [ 598.434324] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 08:44:18 (1788439458) [ 606.894557] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 607.322987] LustreError: 19325:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 607.408644] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 612.837145] LustreError: 19326:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 612.853895] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 622.198590] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 628.772916] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 637.923877] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 644.723700] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 653.309370] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 661.746418] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 670.672486] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 686.780929] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 697.826660] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 697.836681] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 697.854965] Lustre: Skipped 2 previous similar messages [ 697.863058] Lustre: Skipped 3 previous similar messages [ 709.088149] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 709.466205] Lustre: server umount lustre-MDT0000 complete [ 713.185717] LustreError: 20053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 713.219969] LustreError: 20053:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 713.878704] LustreError: 19305:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788439576 with bad export cookie 14287572934232920320 [ 713.894290] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 714.504491] Lustre: server umount lustre-MDT0001 complete [ 730.415102] Lustre: server umount lustre-OST0000 complete [ 754.332479] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 766.769803] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 767.549168] LustreError: 23735:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 767.697480] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 767.720266] Lustre: Skipped 2 previous similar messages [ 773.755734] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 784.570883] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 790.734497] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 794.570904] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 801.613669] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 812.305661] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 825.213503] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 825.486171] Lustre: lustre-OST0001: new disk, initializing [ 825.501149] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 825.516152] Lustre: 26053:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 827.528188] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 827.554891] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 827.756502] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 835.475583] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 847.690196] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 854.026532] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 871.912448] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 871.927057] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 871.950773] Lustre: Skipped 1 previous similar message [ 871.969301] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 871.977995] Lustre: Skipped 6 previous similar messages [ 875.904956] Lustre: server umount lustre-MDT0000 complete [ 879.089901] LustreError: 25418:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 879.119715] LustreError: 25418:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 881.337801] LustreError: 24874:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788439744 with bad export cookie 14287572934232921167 [ 881.342837] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 881.342950] LustreError: 24874:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 881.931456] Lustre: server umount lustre-MDT0001 complete [ 897.816533] Lustre: server umount lustre-OST0000 complete [ 900.384183] Lustre: 3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788439747/real 1788439747] req@ffff9e99585baa00 x1875314198450304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788439763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 902.432215] Lustre: 3650:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788439749/real 1788439749] req@ffff9e9843d67b80 x1875314198450560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788439765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 903.319201] Lustre: server umount lustre-OST0001 complete [ 924.398559] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 935.913082] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 936.999885] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 937.008830] Lustre: Skipped 3 previous similar messages [ 942.831141] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 946.148569] LustreError: 29076:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 946.179805] LustreError: 29076:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 952.703707] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 957.204725] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 959.772793] Lustre: 30224:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 967.772469] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 975.820705] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 985.645156] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 993.141514] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1001.840945] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1006.497742] Lustre: 32104:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1014.755171] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1014.761766] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1014.782806] Lustre: Skipped 4 previous similar messages [ 1014.787495] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1014.789887] Lustre: Skipped 4 previous similar messages [ 1020.496866] Lustre: server umount lustre-MDT0000 complete [ 1024.673901] LustreError: 29056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788439887 with bad export cookie 14287572934232922462 [ 1024.681342] LustreError: 29056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1024.686600] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1025.194991] Lustre: server umount lustre-MDT0001 complete [ 1039.976688] Lustre: server umount lustre-OST0000 complete [ 1042.212467] Lustre: 3649:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788439889/real 1788439889] req@ffff9e99764a1c00 x1875314198503552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788439905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1044.558780] Lustre: server umount lustre-OST0001 complete [ 1055.290709] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 08:51:55 (1788439915) [ 1090.761535] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 1103.745635] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1104.203957] LustreError: 34922:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1104.214754] LustreError: 34922:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 8 previous similar messages [ 1109.259863] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1118.540845] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1123.383525] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1126.392516] Lustre: 36072:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1132.776309] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1140.078609] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1149.000745] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1155.272211] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1164.230569] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1167.750704] Lustre: 37951:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1175.009059] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1175.013178] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1175.024187] Lustre: Skipped 4 previous similar messages [ 1175.028658] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1175.038126] Lustre: Skipped 4 previous similar messages [ 1179.757150] Lustre: server umount lustre-MDT0000 complete [ 1183.526222] LustreError: 34904:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788440046 with bad export cookie 14287572934232923568 [ 1183.537430] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1183.542841] LustreError: 34904:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1184.042583] Lustre: server umount lustre-MDT0001 complete [ 1198.729661] Lustre: server umount lustre-OST0000 complete [ 1202.528870] Lustre: 3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788440049/real 1788440049] req@ffff9e997f39fb80 x1875314198553344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788440065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1203.438157] Lustre: server umount lustre-OST0001 complete [ 1212.883206] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 08:54:33 (1788440073) [ 1232.840096] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 1244.280546] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1244.905904] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1244.910972] Lustre: Skipped 7 previous similar messages [ 1250.880928] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1264.691841] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1271.917437] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1274.391319] Lustre: 41243:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1282.772210] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1290.346358] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1299.507594] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1306.647091] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1314.267195] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1318.063554] Lustre: 43122:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1319.112557] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1319.116420] Lustre: Skipped 1 previous similar message [ 1325.543425] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1325.557958] Lustre: Skipped 6 previous similar messages [ 1329.098373] Lustre: server umount lustre-MDT0000 complete [ 1333.302250] LustreError: 40073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788440196 with bad export cookie 14287572934232924674 [ 1333.311667] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1333.314393] LustreError: 40073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1340.075830] Lustre: server umount lustre-MDT0001 complete [ 1349.996901] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1363.948629] LustreError: 41607:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1363.978114] LustreError: 41607:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 29 previous similar messages [ 1364.814984] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1369.070612] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1374.286768] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1379.950896] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1380.367447] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1380.393464] Lustre: Skipped 1 previous similar message [ 1389.794329] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1392.375798] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1399.825754] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1402.079827] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1410.550777] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1414.591324] Lustre: server umount lustre-MDT0000 complete [ 1418.663209] LustreError: 40074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788440281 with bad export cookie 14287572934232925801 [ 1418.666857] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1418.673899] LustreError: 40074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1418.957783] Lustre: server umount lustre-MDT0001 complete [ 1432.527508] Lustre: server umount lustre-OST0000 complete [ 1447.237664] Lustre: server umount lustre-OST0001 complete [ 1456.655466] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 08:58:37 (1788440317) [ 1475.095230] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 1487.676416] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1494.250481] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1504.144853] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1510.807133] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1514.267847] Lustre: 48886:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1522.227100] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1529.577182] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1539.309675] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1547.110925] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1555.044578] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1560.031664] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1573.940959] Lustre: server umount lustre-MDT0000 complete [ 1578.359593] LustreError: 47715:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788440441 with bad export cookie 14287572934232926606 [ 1578.364872] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1578.372588] LustreError: 47715:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1578.691186] Lustre: server umount lustre-MDT0001 complete [ 1592.636866] Lustre: server umount lustre-OST0000 complete [ 1596.390119] Lustre: 3650:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788440443/real 1788440443] req@ffff9e994ff77480 x1875314198706944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788440459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1596.447935] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1596.461906] Lustre: Skipped 11 previous similar messages [ 1597.439902] Lustre: server umount lustre-OST0001 complete [ 1609.283829] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 09:01:09 (1788440469) [ 1612.121399] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1614.121421] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 09:01:14 (1788440474) [ 1626.572548] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 1636.462032] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 1661.397122] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1661.729615] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1661.914229] Lustre: lustre-MDT0000: new disk, initializing [ 1662.054825] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1667.809738] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1677.922303] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1684.144645] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1684.395629] Lustre: lustre-OST0000: new disk, initializing [ 1684.399142] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1684.404640] Lustre: Skipped 1 previous similar message [ 1684.410380] Lustre: 54979:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1686.317180] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1686.324125] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1686.353315] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1690.132531] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1699.386630] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1702.169364] Lustre: DEBUG MARKER: create test files [ 1737.700352] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1737.715702] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1737.722088] Lustre: Skipped 19 previous similar messages [ 1739.827492] Lustre: server umount lustre-OST0000 complete [ 1744.358905] Lustre: server umount lustre-MDT0000 complete [ 1758.648140] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 1762.217674] Key type lgssc unregistered [ 1762.662902] LNet: 56609:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1762.672902] LNetError: 56609:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1762.685702] LNet: Removed LNI 192.168.202.126@tcp [ 1763.842134] Key type .llcrypt unregistered [ 1763.843769] Key type ._llcrypt unregistered [ 1797.033132] Key type ._llcrypt registered [ 1797.035587] Key type .llcrypt registered [ 1797.148989] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 1798.353904] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1798.453756] alg: No test for adler32 (adler32-zlib) [ 1799.393136] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 1799.561032] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 1801.192191] Key type lgssc registered [ 1802.324806] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1812.202294] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1812.244155] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1813.968913] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1819.968603] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1828.786491] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1837.630515] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1838.116668] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1839.157700] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1839.337917] Lustre: 59344:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1839.348831] Lustre: 59344:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1839.361962] Lustre: 59344:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1839.370268] Lustre: 59344:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1839.375845] Lustre: 59344:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1839.386680] Lustre: 59344:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1846.150741] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1855.305557] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1861.612954] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1867.605704] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1874.913617] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1874.923655] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1874.937514] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1876.391743] Lustre: server umount lustre-OST0000 complete [ 1880.829483] Lustre: server umount lustre-MDT0000 complete [ 1893.496529] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 1896.946284] Key type lgssc unregistered [ 1897.362436] LNet: 60951:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1897.369261] LNetError: 60951:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1897.389628] LNet: Removed LNI 192.168.202.126@tcp [ 1898.370181] Key type .llcrypt unregistered [ 1898.376574] Key type ._llcrypt unregistered [ 1932.238389] Key type ._llcrypt registered [ 1932.246926] Key type .llcrypt registered [ 1932.422270] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 1934.647255] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1934.665091] alg: No test for adler32 (adler32-zlib) [ 1935.754099] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 1936.224668] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 1938.016198] Key type lgssc registered [ 1940.042579] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1950.815968] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1950.863417] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1952.611504] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1958.414673] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1966.794741] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1973.583698] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1973.988111] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1978.094433] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1978.140165] Lustre: 63787:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1978.147090] Lustre: 63787:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1978.154597] Lustre: 63787:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1978.161374] Lustre: 63787:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1978.166441] Lustre: 63787:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1978.169896] Lustre: 63787:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1980.198333] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 1986.984665] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1992.747851] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 2003.938981] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2003.970887] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2006.878504] Lustre: server umount lustre-OST0000 complete [ 2010.696642] Lustre: server umount lustre-MDT0000 complete [ 2021.086834] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 2023.780754] Key type lgssc unregistered [ 2024.095862] LNet: 65344:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2024.105488] LNetError: 65344:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2025.128229] LNet: Removed LNI 192.168.202.126@tcp [ 2026.233043] Key type .llcrypt unregistered [ 2026.234342] Key type ._llcrypt unregistered [ 2050.009802] Key type ._llcrypt registered [ 2050.016308] Key type .llcrypt registered [ 2050.223579] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 2069.972219] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 2071.503347] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2071.740763] alg: No test for adler32 (adler32-zlib) [ 2072.843765] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 2073.204914] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 2074.936441] Key type lgssc registered [ 2076.598821] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2113.537607] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2113.565454] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2114.928882] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2114.980867] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2115.123128] Lustre: lustre-MDT0000: new disk, initializing [ 2115.244296] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2115.271923] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2120.038996] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2131.025189] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2131.271743] Lustre: 68496:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2131.357345] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2131.363165] Lustre: Skipped 1 previous similar message [ 2131.498821] Lustre: lustre-MDT0001: new disk, initializing [ 2131.621366] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2131.672502] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2131.696265] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2137.035432] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2147.989891] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2156.102193] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2163.941345] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2164.429278] Lustre: lustre-OST0000: new disk, initializing [ 2164.433048] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2164.444206] Lustre: 70464:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2164.601358] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2169.966176] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2169.985612] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2170.144066] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2172.068363] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2182.904870] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2188.616308] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2188.900354] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2194.243995] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2194.534673] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2201.062783] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2201.081221] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2201.101851] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2201.117102] Lustre: Skipped 1 previous similar message [ 2206.196397] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2206.204112] Lustre: Skipped 1 previous similar message [ 2211.296207] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2211.302895] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2211.315957] Lustre: Skipped 1 previous similar message [ 2211.479571] Lustre: server umount lustre-OST0000 complete [ 2216.431116] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2216.443181] Lustre: Skipped 2 previous similar messages [ 2216.448652] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2216.461054] Lustre: Skipped 1 previous similar message [ 2221.539329] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2221.543503] Lustre: Skipped 1 previous similar message [ 2222.555398] Lustre: server umount lustre-MDT0000 complete [ 2226.304805] LustreError: 68486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788441089 with bad export cookie 4385508008740853170 [ 2226.312176] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2226.317588] LustreError: 68486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2226.609296] Lustre: server umount lustre-MDT0001 complete [ 2235.797468] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 09:11:36 (1788441096) [ 2245.793107] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 2294.479740] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 2305.564284] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 2345.825146] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2346.094230] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2346.115844] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2346.173755] Lustre: lustre-MDT0000: new disk, initializing [ 2346.274335] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2346.305173] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2350.904707] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2362.567063] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2362.715161] Lustre: 76492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2362.779088] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2362.783241] Lustre: Skipped 1 previous similar message [ 2362.913404] Lustre: lustre-MDT0001: new disk, initializing [ 2363.020988] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2363.069743] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2363.080546] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2367.445550] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2378.311898] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2384.384812] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2392.008874] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2392.380390] Lustre: lustre-OST0000: new disk, initializing [ 2392.394599] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2392.404580] Lustre: 78459:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2392.480382] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2397.821823] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2397.838959] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2398.008735] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2399.573869] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2410.057993] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2415.604488] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2415.810536] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2421.237549] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2421.499962] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2423.778705] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2423.789115] LustreError: Skipped 1 previous similar message [ 2423.791724] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2423.806437] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2429.935425] Lustre: server umount lustre-OST0000 complete [ 2434.017276] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2434.036586] Lustre: Skipped 2 previous similar messages [ 2444.259777] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2444.270937] Lustre: Skipped 8 previous similar messages [ 2448.352159] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2448.581848] Lustre: server umount lustre-MDT0000 complete [ 2452.302318] LustreError: 76484:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788441315 with bad export cookie 4385508008740854052 [ 2452.304473] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2452.314711] LustreError: 76484:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2452.770804] Lustre: server umount lustre-MDT0001 complete [ 2461.543500] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 09:15:22 (1788441322) [ 2468.752287] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2469.188290] LustreError: 80873:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2469.211804] LustreError: 80873:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2469.260984] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2473.959640] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2474.465765] LustreError: 80874:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2479.589786] LustreError: 80873:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2483.821408] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2490.464695] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2499.620444] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2506.196886] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2514.825864] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2514.921502] LustreError: 82699:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2515.275236] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2515.280328] Lustre: Skipped 1 previous similar message [ 2522.548360] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2530.668788] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2534.802780] Lustre: 83548:0:(genops.c:1774:obd_export_evict_by_uuid()) MGS: evicting 7133d1e4-c190-4e3c-b19b-c17bcaad65dd at adminstrative request [ 2534.911042] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2534.929781] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2545.162219] Lustre: MGS: Client 7133d1e4-c190-4e3c-b19b-c17bcaad65dd (at 0@lo) reconnecting [ 2545.177278] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x3cdc744c6ca11c96 to 0x3cdc744c6ca11f36 [ 2545.209736] Lustre: MGC192.168.202.126@tcp: Connection restored to 0@lo (at 0@lo) [ 2572.536939] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2572.725442] Lustre: lustre-OST0001: new disk, initializing [ 2572.728662] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2572.732842] Lustre: 83942:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2580.137933] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2581.597947] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2581.607188] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2581.732387] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2590.825150] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2597.355274] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2597.362160] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2597.364782] LustreError: Skipped 1 previous similar message [ 2597.369403] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2597.412949] Lustre: Skipped 1 previous similar message [ 2600.710742] Lustre: server umount lustre-OST0001 complete [ 2602.472075] LustreError: 82699:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2602.489843] LustreError: 82699:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2606.563977] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2606.572265] LustreError: Skipped 1 previous similar message [ 2606.586857] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2610.891755] Lustre: server umount lustre-OST0000 complete [ 2617.314256] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2617.323743] LustreError: Skipped 1 previous similar message [ 2622.129441] Lustre: server umount lustre-MDT0000 complete [ 2622.949106] LustreError: 82949:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2622.964598] LustreError: 82949:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2626.547037] LustreError: 83953:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788441489 with bad export cookie 4385508008740855606 [ 2626.551920] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2626.561830] LustreError: 83953:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2627.181665] Lustre: server umount lustre-MDT0001 complete [ 2636.565972] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 09:18:17 (1788441497) [ 2638.301590] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2639.897700] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 09:18:21 (1788441501) [ 2641.405070] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2643.429854] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 09:18:24 (1788441504) [ 2645.208611] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2646.961097] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 09:18:28 (1788441508) [ 2648.528238] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2650.526338] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 09:18:31 (1788441511) [ 2652.069489] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2658.412838] loop: module loaded [ 2658.437449] loop0: detected capacity change from 0 to 4294967296 [ 2658.523969] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2660.386342] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2664.355712] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2668.920846] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2699.668049] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2699.778467] LustreError: 88072:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2699.790893] LustreError: 88072:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2699.798963] LustreError: 88072:0:(tgt_mount.c:2585:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2699.805526] LustreError: 88072:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2723.850941] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 2736.092960] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 2774.829678] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2775.092711] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2775.114401] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2775.178301] Lustre: lustre-MDT0000: new disk, initializing [ 2775.243343] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2775.248371] Lustre: Skipped 1 previous similar message [ 2775.264655] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2779.842585] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2790.102720] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2790.364200] Lustre: 90936:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2790.796990] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2795.796225] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2805.619141] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2812.113716] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2819.737571] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2820.044303] Lustre: 92906:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2825.835768] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2825.999234] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2827.931335] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2838.119988] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2843.457388] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2843.724711] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2849.395479] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2849.738226] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2856.929944] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2856.952370] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2856.973562] Lustre: Skipped 3 previous similar messages [ 2856.990549] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2857.004227] Lustre: Skipped 6 previous similar messages [ 2866.144497] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2866.360749] Lustre: server umount lustre-OST0000 complete [ 2877.107325] Lustre: server umount lustre-MDT0000 complete [ 2877.410131] LustreError: 90951:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2877.420227] LustreError: 90951:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2881.601319] LustreError: 90930:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788441744 with bad export cookie 4385508008740856222 [ 2881.619842] LustreError: 90930:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2881.626699] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2882.237607] Lustre: server umount lustre-MDT0001 complete [ 2892.105403] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 09:22:32 (1788441752) [ 2899.985894] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2906.070300] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2910.189425] LustreError: 95322:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2910.220625] LustreError: 95322:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 2914.717192] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2915.113851] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 2915.119305] Lustre: Skipped 3 previous similar messages [ 2920.389899] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2929.079650] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2935.868597] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2943.587303] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2952.128229] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2960.337106] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2965.477959] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2965.732624] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2970.530618] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2970.791187] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2977.934906] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2978.103254] Lustre: lustre-OST0001: new disk, initializing [ 2978.105903] Lustre: Skipped 2 previous similar messages [ 2978.108547] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2978.111071] Lustre: Skipped 3 previous similar messages [ 2978.114719] Lustre: 98693:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2985.074207] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2985.086294] Lustre: Skipped 2 previous similar messages [ 2985.096119] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2985.278563] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2985.432597] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 2996.442225] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3002.676913] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 3002.915727] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3008.031965] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 3008.302468] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3031.145065] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3056.770695] Lustre: Failing over lustre-MDT0000 [ 3056.998430] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.26@tcp (stopping) [ 3057.012869] Lustre: Skipped 5 previous similar messages [ 3057.125734] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3057.133573] Lustre: Skipped 3 previous similar messages [ 3057.256949] Lustre: server umount lustre-MDT0000 complete [ 3062.067091] LustreError: 95317:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3062.091824] LustreError: 95317:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 3078.630500] Lustre: 66718:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788441925/real 1788441925] req@000000004eb08c8e x1875316243193472/t0(0) o400->MGC192.168.202.126@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788441941 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3078.671556] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3083.527690] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 3083.530292] LDISKFS-fs (dm-0): recovery complete [ 3083.536237] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3088.867960] LustreError: 66717:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@0000000024739dc7 x1875316243201280/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3089.410546] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3092.794045] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3092.801899] Lustre: 95319:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3094.506354] Lustre: 95323:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3094.511109] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3094.519382] Lustre: 95323:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 1 previous similar message [ 3094.662826] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3094.791576] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3095.011311] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3095.346641] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3095.361751] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 3095.694914] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3095.716313] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 3095.735399] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3095.745734] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 7 previous similar messages [ 3096.393380] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3096.402733] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 3096.722249] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3096.734339] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 3098.024085] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3098.047178] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 6 previous similar messages [ 3098.690680] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3098.698884] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 6 previous similar messages [ 3099.024125] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3099.028032] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 6 previous similar messages [ 3102.201781] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3102.218242] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 12 previous similar messages [ 3102.863081] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3102.875571] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 3103.208069] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3103.212362] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 3110.210292] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3110.225287] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 24 previous similar messages [ 3110.877768] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3110.882908] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 3111.515473] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3111.521947] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 25 previous similar messages [ 3126.497323] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3126.520070] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 50 previous similar messages [ 3127.169589] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3127.183887] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 50 previous similar messages [ 3127.824131] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3127.827710] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 50 previous similar messages [ 3152.312165] Lustre: 101543:0:(ldlm_lib.c:2419:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 3152.319475] Lustre: 101543:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3152.324343] Lustre: 101543:0:(genops.c:1601:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 47cc47a2-8e55-423b-9a2c-03b3553fb0da@192.168.202.26@tcp [ 3152.330969] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3152.334361] Lustre: 101543:0:(ldlm_lib.c:1939:abort_req_replay_queue()) @@@ aborted: req@00000000bf878ce7 x1875316222007424/t0(8589934777) o101->47cc47a2-8e55-423b-9a2c-03b3553fb0da@192.168.202.26@tcp:290/0 lens 592/0 e 0 to 0 dl 1788442025 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 3152.361565] Lustre: lustre-MDT0000: Denying connection for new client 47cc47a2-8e55-423b-9a2c-03b3553fb0da (at 192.168.202.26@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 3152.363765] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 3152.403555] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 3152.435552] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3152.438030] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 3152.439096] Lustre: Skipped 2 previous similar messages [ 3152.472795] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 3152.473214] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 3166.203630] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3166.217059] Lustre: Skipped 3 previous similar messages [ 3171.298081] Lustre: server umount lustre-OST0000 complete [ 3181.365963] Lustre: server umount lustre-OST0001 complete [ 3191.783204] LustreError: 99420:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3191.798792] LustreError: 99420:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 45 previous similar messages [ 3191.905229] Lustre: server umount lustre-MDT0000 complete [ 3195.850542] LustreError: 95302:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788442058 with bad export cookie 4385508008740907441 [ 3195.852723] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3195.857988] LustreError: 95302:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3196.634809] Lustre: server umount lustre-MDT0001 complete [ 3207.085780] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 09:27:47 (1788442067) [ 3215.593474] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3215.598527] Lustre: *** cfs_fail_loc=197, val=0*** [ 3231.136574] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3236.256512] LustreError: 103517:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.126@tcp: failed processing log, type 4: rc = -110 [ 3241.457510] Lustre: *** cfs_fail_loc=197, val=0*** [ 3241.459709] Lustre: Skipped 65 previous similar messages [ 3261.984534] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3261.988983] Lustre: Skipped 3 previous similar messages [ 3267.917624] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3275.853878] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3278.341429] Lustre: server umount lustre-OST0000 complete [ 3287.556673] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 09:29:08 (1788442148) [ 3309.415451] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3314.809096] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3324.430783] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3328.491548] LustreError: 105170:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3328.516935] LustreError: 105170:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3328.529838] LustreError: 105170:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 19, retries 0, failed: rc = -5 [ 3328.974374] Lustre: server umount lustre-MDT0000 complete [ 3365.856813] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 3377.479841] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 3415.741757] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3415.983310] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3416.003971] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3416.130351] Lustre: lustre-MDT0000: new disk, initializing [ 3416.300391] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3420.907732] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3432.591190] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3432.679122] Lustre: 109345:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3433.063073] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3438.051219] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3447.759272] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3452.930594] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3459.916556] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3460.310175] Lustre: 111311:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3466.992621] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3467.545147] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3476.926895] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3482.013527] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3482.247593] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3487.084221] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3487.336098] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3493.389920] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3493.393194] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3493.411608] LustreError: Skipped 1 previous similar message [ 3493.412456] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3493.434279] Lustre: Skipped 6 previous similar messages [ 3493.456182] Lustre: Skipped 11 previous similar messages [ 3495.485674] Lustre: server umount lustre-OST0000 complete [ 3499.489684] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3499.498159] LustreError: Skipped 1 previous similar message [ 3505.771116] Lustre: server umount lustre-MDT0000 complete [ 3508.707259] LustreError: 109356:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3508.743898] LustreError: 109356:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 3509.678368] LustreError: 109336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788442372 with bad export cookie 4385508008740918095 [ 3509.693499] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3509.695497] LustreError: 109336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3510.156312] Lustre: server umount lustre-MDT0001 complete [ 3519.199860] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 09:32:59 (1788442379) [ 3529.587766] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 3533.216915] Key type lgssc unregistered [ 3533.578621] LNet: 113798:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3533.584894] LNetError: 113798:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3534.636907] LNet: Removed LNI 192.168.202.126@tcp [ 3535.818607] Key type .llcrypt unregistered [ 3535.822706] Key type ._llcrypt unregistered [ 3555.438802] Key type ._llcrypt registered [ 3555.440456] Key type .llcrypt registered [ 3555.588607] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 3573.331489] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 3574.469253] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3574.550136] alg: No test for adler32 (adler32-zlib) [ 3575.652849] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 3575.893823] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 3577.712131] Key type lgssc registered [ 3579.375298] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3624.322943] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3624.352600] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3625.680551] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3625.720598] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3625.845661] Lustre: lustre-MDT0000: new disk, initializing [ 3625.943327] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3625.964619] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3631.206675] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3641.523694] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3641.813624] Lustre: lustre-OST0000: new disk, initializing [ 3641.816470] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3641.820960] Lustre: Skipped 1 previous similar message [ 3641.825219] Lustre: 117971:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3641.878769] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3643.019544] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3643.029586] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3643.073187] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3647.658800] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3658.390767] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3658.535764] Lustre: lustre-OST0001: new disk, initializing [ 3658.538709] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3658.543672] Lustre: 118834:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3658.632815] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3664.548264] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3664.556533] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3664.591275] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3664.800514] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3675.105711] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3675.147317] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3675.152375] Lustre: Skipped 1 previous similar message [ 3680.271867] Lustre: server umount lustre-MDT0000 complete [ 3686.984502] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3691.571245] LustreError: 119358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788442554 with bad export cookie 12879860967403815504 [ 3691.575461] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3691.589227] LustreError: 119358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3691.862555] Lustre: server umount lustre-OST0000 complete [ 3695.555748] Lustre: server umount lustre-OST0001 complete [ 3704.124930] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 09:36:05 (1788442565) [ 3726.802652] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 09:36:27 (1788442587) [ 3736.841785] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 3759.331404] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 09:37:00 (1788442620) [ 3799.752250] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 3812.040069] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 3852.327645] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3852.550531] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3852.577437] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3852.640676] Lustre: lustre-MDT0000: new disk, initializing [ 3852.704335] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3852.720654] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3857.312846] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3869.181152] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3869.248802] Lustre: 126597:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3869.293442] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3869.297769] Lustre: Skipped 1 previous similar message [ 3869.394365] Lustre: lustre-MDT0001: new disk, initializing [ 3869.459912] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3869.493852] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3869.505195] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3874.409891] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3884.936875] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3891.698282] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3899.025654] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3899.362486] Lustre: lustre-OST0000: new disk, initializing [ 3899.366607] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3899.375292] Lustre: 128564:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3899.457281] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3906.492282] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3907.129907] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3907.147464] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3907.284704] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3916.534952] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3921.333717] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3921.487530] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3926.383783] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3926.591944] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3933.158700] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3933.161146] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3933.163215] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3933.172443] Lustre: Skipped 2 previous similar messages [ 3934.811448] Lustre: server umount lustre-OST0000 complete [ 3938.279572] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3938.284868] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3938.301712] Lustre: Skipped 1 previous similar message [ 3938.313197] Lustre: Skipped 2 previous similar messages [ 3943.396902] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3943.408876] Lustre: Skipped 1 previous similar message [ 3944.638633] Lustre: server umount lustre-MDT0000 complete [ 3948.437874] LustreError: 126589:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788442811 with bad export cookie 12879860967403816729 [ 3948.439117] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3948.450765] LustreError: 126589:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3949.066109] Lustre: server umount lustre-MDT0001 complete [ 3957.663904] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 09:40:18 (1788442818) [ 3964.325493] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3964.957198] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3969.518787] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3970.021653] LustreError: 130977:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3970.045182] LustreError: 130977:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 3975.147908] LustreError: 130978:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3978.701498] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3984.322871] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 3991.490715] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3997.396749] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4004.868504] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4005.305662] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4005.313502] Lustre: Skipped 1 previous similar message [ 4012.509598] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4020.830455] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4028.457906] Lustre: *** cfs_fail_loc=159, val=0*** [ 4044.147410] Lustre: lustre-MDT0000: Client 8e2e921e-3dac-4df5-b648-b067459d23b6 (at 192.168.202.26@tcp) reconnecting [ 4045.882858] Lustre: *** cfs_fail_loc=159, val=0*** [ 4045.885241] Lustre: Skipped 5 previous similar messages [ 4062.069309] Lustre: lustre-MDT0000: Client 8e2e921e-3dac-4df5-b648-b067459d23b6 (at 192.168.202.26@tcp) reconnecting [ 4069.867267] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4069.877547] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4069.896069] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4069.915528] LustreError: Skipped 1 previous similar message [ 4080.109249] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4080.123417] Lustre: Skipped 3 previous similar messages [ 4082.144792] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4082.380161] Lustre: server umount lustre-OST0000 complete [ 4086.761440] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4086.766465] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4086.787701] Lustre: Skipped 1 previous similar message [ 4092.783143] Lustre: server umount lustre-MDT0000 complete [ 4095.457187] LustreError: 131706:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4095.483595] LustreError: 131706:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4096.698544] LustreError: 134005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788442959 with bad export cookie 12879860967403817611 [ 4096.711939] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4096.985961] Lustre: server umount lustre-MDT0001 complete [ 4107.894777] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 4111.176490] Key type lgssc unregistered [ 4111.507097] LNet: 134756:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4111.520460] LNetError: 134756:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4111.530339] LNet: Removed LNI 192.168.202.126@tcp [ 4112.620544] Key type .llcrypt unregistered [ 4112.622236] Key type ._llcrypt unregistered [ 4137.891252] Key type ._llcrypt registered [ 4137.894417] Key type .llcrypt registered [ 4138.000465] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 4139.166298] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4139.305415] alg: No test for adler32 (adler32-zlib) [ 4140.326868] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 4140.562538] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 4142.256192] Key type lgssc registered [ 4143.612919] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4151.302556] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4151.330969] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4152.759887] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4158.886869] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4163.042055] LustreError: 136166:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4163.087317] LustreError: 136166:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4168.182059] LustreError: 136167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4168.819427] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4169.341596] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4175.380356] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4184.776124] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4190.562210] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4198.308152] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4198.764320] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4205.367870] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4212.741248] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4222.358026] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 4234.313696] Lustre: *** cfs_fail_loc=159, val=0*** [ 4249.958263] Lustre: lustre-MDT0000: Client af431383-6d59-4d86-982b-bb2f86e4c841 (at 192.168.202.26@tcp) reconnecting [ 4252.824762] Lustre: *** cfs_fail_loc=159, val=0*** [ 4269.475739] Lustre: lustre-MDT0001: Client af431383-6d59-4d86-982b-bb2f86e4c841 (at 192.168.202.26@tcp) reconnecting [ 4271.221299] Lustre: *** cfs_fail_loc=159, val=0*** [ 4271.222928] Lustre: Skipped 3 previous similar messages [ 4286.843581] Lustre: lustre-MDT0001: Client af431383-6d59-4d86-982b-bb2f86e4c841 (at 192.168.202.26@tcp) reconnecting [ 4290.473185] Lustre: 139225:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4292.987323] Lustre: *** cfs_fail_loc=159, val=0*** [ 4293.000851] Lustre: Skipped 4 previous similar messages [ 4308.828908] Lustre: lustre-MDT0000: Client 0bda4892-5e76-48ae-b604-2b422485d4b7 (at 192.168.202.26@tcp) reconnecting [ 4310.333045] Lustre: *** cfs_fail_loc=159, val=0*** [ 4310.335619] Lustre: Skipped 13 previous similar messages [ 4325.877804] Lustre: lustre-MDT0000: Client 0bda4892-5e76-48ae-b604-2b422485d4b7 (at 192.168.202.26@tcp) reconnecting [ 4328.924270] Lustre: 139519:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4337.128543] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 4337.130906] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4337.133556] LustreError: Skipped 2 previous similar messages [ 4337.153471] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4338.000151] Lustre: server umount lustre-OST0000 complete [ 4343.265165] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4343.276937] LustreError: Skipped 2 previous similar messages [ 4343.286360] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4343.345194] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4345.316288] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4345.318856] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4349.871949] Lustre: server umount lustre-MDT0000 complete [ 4350.446874] LustreError: 136166:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4350.478918] LustreError: 136166:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4353.101543] LustreError: 139349:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788443215 with bad export cookie 16970975573831200900 [ 4353.109011] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4353.122958] LustreError: 139349:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4362.617712] Lustre: server umount lustre-MDT0001 complete [ 4374.551226] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 4378.128808] Key type lgssc unregistered [ 4378.481739] LNet: 140577:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4378.498825] LNetError: 140577:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4378.518411] LNet: Removed LNI 192.168.202.126@tcp [ 4379.565203] Key type .llcrypt unregistered [ 4379.566920] Key type ._llcrypt unregistered [ 4407.657851] Key type ._llcrypt registered [ 4407.661309] Key type .llcrypt registered [ 4407.799748] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 4408.838390] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4408.861902] alg: No test for adler32 (adler32-zlib) [ 4410.074781] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 4410.308862] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 4411.968196] Key type lgssc registered [ 4412.984133] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4420.165417] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4420.177841] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4421.572684] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4426.294692] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4431.846913] LustreError: 141989:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4431.872024] LustreError: 141989:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4433.402617] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4433.962612] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4439.198639] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4448.447686] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4455.149905] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4463.440427] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4463.761518] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4466.897804] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4470.619536] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4478.663841] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4479.178255] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4485.045176] Lustre: 144574:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4488.185587] Lustre: 144623:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4489.433958] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4490.262366] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4493.368389] Lustre: 144768:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4494.346393] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4495.349250] Lustre: 144866:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4499.940110] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4499.942505] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4499.962757] Lustre: Skipped 1 previous similar message [ 4499.989540] Lustre: Skipped 1 previous similar message [ 4505.058260] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4505.065747] Lustre: Skipped 1 previous similar message [ 4505.716045] Lustre: server umount lustre-OST0000 complete [ 4510.184236] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4510.188214] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4510.194048] Lustre: Skipped 1 previous similar message [ 4510.203695] Lustre: Skipped 1 previous similar message [ 4515.299178] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4515.309627] Lustre: Skipped 1 previous similar message [ 4516.401247] Lustre: server umount lustre-MDT0000 complete [ 4520.426408] LustreError: 142956:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4520.437887] LustreError: 141969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788443383 with bad export cookie 13576858387149465375 [ 4520.438498] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4520.440735] LustreError: 142956:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4520.461436] LustreError: 141969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4520.923931] Lustre: server umount lustre-MDT0001 complete [ 4534.350260] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 4537.864839] Key type lgssc unregistered [ 4538.190971] LNet: 145926:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4538.202572] LNetError: 145926:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4538.219562] LNet: Removed LNI 192.168.202.126@tcp [ 4539.641203] Key type .llcrypt unregistered [ 4539.643375] Key type ._llcrypt unregistered [ 4567.685227] Key type ._llcrypt registered [ 4567.687351] Key type .llcrypt registered [ 4567.791876] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 4569.178479] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4569.479387] alg: No test for adler32 (adler32-zlib) [ 4570.526552] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 4570.958097] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 4572.708218] Key type lgssc registered [ 4573.995698] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4581.973432] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4582.021452] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4583.480490] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4588.712369] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4593.635783] LustreError: 147340:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4593.654114] LustreError: 147340:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4597.890855] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4598.310745] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4603.370698] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4611.192191] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4617.514566] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4624.498262] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4624.756958] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4628.889416] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4631.378658] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4638.660274] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4643.211296] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4648.574352] Lustre: *** cfs_fail_loc=159, val=0*** [ 4664.159273] Lustre: lustre-MDT0000: Client be781521-38e6-40b4-960b-9258077c88e2 (at 192.168.202.26@tcp) reconnecting [ 4668.900709] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4668.916221] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4668.920720] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4670.241972] Lustre: server umount lustre-OST0000 complete [ 4674.021963] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4674.024661] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4674.038360] Lustre: Skipped 2 previous similar messages [ 4674.046076] Lustre: Skipped 1 previous similar message [ 4679.139916] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4679.146287] Lustre: Skipped 2 previous similar messages [ 4684.259815] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4684.267683] Lustre: Skipped 1 previous similar message [ 4688.352152] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4688.361209] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4688.374962] Lustre: Skipped 1 previous similar message [ 4688.544293] Lustre: server umount lustre-MDT0000 complete [ 4691.940284] LustreError: 147322:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788443554 with bad export cookie 15636215975091526537 [ 4691.947106] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4691.949406] LustreError: 147322:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4692.391978] Lustre: server umount lustre-MDT0001 complete [ 4703.759984] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 4707.976596] Key type lgssc unregistered [ 4708.269161] LNet: 151003:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4708.285655] LNetError: 151003:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4708.318295] LNet: Removed LNI 192.168.202.126@tcp [ 4709.121271] Key type .llcrypt unregistered [ 4709.123422] Key type ._llcrypt unregistered [ 4738.360343] Key type ._llcrypt registered [ 4738.364300] Key type .llcrypt registered [ 4738.502248] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 4739.986668] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4740.057490] alg: No test for adler32 (adler32-zlib) [ 4741.290109] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 4741.578485] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 4743.333744] Key type lgssc registered [ 4744.914729] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4752.804572] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4752.814777] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4754.152664] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4759.298738] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4763.620228] LustreError: 152414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4763.633023] LustreError: 152414:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4768.601599] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4768.742714] LustreError: 152415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4769.212698] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4775.283249] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4785.503513] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4790.274533] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4796.913957] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4797.527573] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4798.601359] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4803.314425] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 4810.782241] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4813.944605] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4836.160853] Lustre: lustre-MDT0001: evicting 0a55706b-c5da-48d5-a32d-a6e62fbfe562 (at 192.168.202.26@tcp) by administrative request [ 4836.170681] Lustre: Skipped 1 previous similar message [ 4870.629239] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4870.631038] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4870.691056] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4870.712338] Lustre: Skipped 1 previous similar message [ 4874.005591] Lustre: server umount lustre-OST0000 complete [ 4880.867626] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4880.892891] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4880.894601] Lustre: Skipped 2 previous similar messages [ 4880.913149] Lustre: Skipped 1 previous similar message [ 4885.218827] Lustre: server umount lustre-MDT0000 complete [ 4885.985086] LustreError: 152415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4886.021964] LustreError: 152415:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4890.727022] LustreError: 152395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788443753 with bad export cookie 3145253158450851028 [ 4890.729739] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4890.736338] LustreError: 152395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4891.435887] Lustre: server umount lustre-MDT0001 complete [ 4910.906137] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 4913.897675] Key type lgssc unregistered [ 4914.282145] LNet: 156509:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4914.292361] LNetError: 156509:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4915.307772] LNet: Removed LNI 192.168.202.126@tcp [ 4916.208977] Key type .llcrypt unregistered [ 4916.215457] Key type ._llcrypt unregistered [ 4999.519215] Key type ._llcrypt registered [ 4999.521918] Key type .llcrypt registered [ 4999.638533] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 5001.317371] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5001.360071] alg: No test for adler32 (adler32-zlib) [ 5002.529477] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 5002.870509] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 5004.553570] Key type lgssc registered [ 5006.005656] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5013.884468] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5013.909074] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5015.425919] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5020.001437] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5025.765521] LustreError: 159001:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5025.773641] LustreError: 159001:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5028.074741] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5028.673277] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5033.669430] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5040.859880] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5046.660904] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5054.724881] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5055.188041] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5060.353995] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 5062.506371] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5071.593620] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5073.692238] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 5084.136256] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5084.141356] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5084.151755] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5084.155926] Lustre: Skipped 1 previous similar message [ 5088.808552] Lustre: server umount lustre-OST0000 complete [ 5094.372077] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5094.401046] Lustre: Skipped 1 previous similar message [ 5094.405772] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5094.435917] Lustre: Skipped 1 previous similar message [ 5099.374397] Lustre: server umount lustre-MDT0000 complete [ 5099.489452] LustreError: 158994:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5099.523735] LustreError: 158994:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 5103.750696] LustreError: 158983:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788443966 with bad export cookie 10457481663951014962 [ 5103.763692] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5103.783475] LustreError: 158983:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5104.236601] Lustre: server umount lustre-MDT0001 complete [ 5118.287424] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 5121.981802] Key type lgssc unregistered [ 5122.261605] LNet: 162543:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5122.274864] LNetError: 162543:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5123.306467] LNet: Removed LNI 192.168.202.126@tcp [ 5124.233558] Key type .llcrypt unregistered [ 5124.236038] Key type ._llcrypt unregistered [ 5149.619603] Key type ._llcrypt registered [ 5149.622041] Key type .llcrypt registered [ 5149.721120] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 5150.997898] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5151.086508] alg: No test for adler32 (adler32-zlib) [ 5152.220421] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 5152.481123] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 5154.128149] Key type lgssc registered [ 5155.408507] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5170.806385] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 10:00:31 (1788444031) [ 5188.620988] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 5201.407526] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 5243.958114] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5243.987058] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5245.407586] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5245.452491] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5245.545361] Lustre: lustre-MDT0000: new disk, initializing [ 5245.614869] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5245.628355] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5250.624964] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5264.126214] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5264.299909] Lustre: 166818:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5264.419618] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5264.425256] Lustre: Skipped 1 previous similar message [ 5264.677671] Lustre: lustre-MDT0001: new disk, initializing [ 5264.808793] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5264.889274] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5264.908587] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5270.101788] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5279.595349] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5285.992020] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5292.600081] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5292.831650] Lustre: lustre-OST0000: new disk, initializing [ 5292.835595] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5292.840937] Lustre: 168789:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5292.966940] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5298.838219] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5300.239956] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5300.249800] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5300.291501] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5306.642719] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5320.680457] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5320.681716] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5320.728001] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5322.555812] Lustre: server umount lustre-OST0000 complete [ 5330.916065] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5330.934174] Lustre: Skipped 1 previous similar message [ 5330.940474] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5330.943053] Lustre: Skipped 1 previous similar message [ 5332.910543] Lustre: server umount lustre-MDT0000 complete [ 5336.733528] LustreError: 166809:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788444199 with bad export cookie 9354676097088269115 [ 5336.739164] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5336.745469] LustreError: 166809:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5337.166061] Lustre: server umount lustre-MDT0001 complete [ 5349.250267] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 5352.387388] Key type lgssc unregistered [ 5352.626389] LNet: 170692:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5352.633961] LNetError: 170692:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5352.672073] LNet: Removed LNI 192.168.202.126@tcp [ 5353.475515] Key type .llcrypt unregistered [ 5353.478714] Key type ._llcrypt unregistered [ 5380.827485] Key type ._llcrypt registered [ 5380.833857] Key type .llcrypt registered [ 5380.928990] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 5382.054053] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5382.099519] alg: No test for adler32 (adler32-zlib) [ 5383.292292] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 5383.556865] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 5385.331135] Key type lgssc registered [ 5386.988745] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5394.062934] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5394.075163] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5395.611689] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5400.533031] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5405.162642] LustreError: 172105:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5405.182494] LustreError: 172105:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5409.714043] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5410.257822] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5413.923724] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5422.304545] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5428.858598] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5434.874716] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5435.200147] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5440.330121] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5440.589353] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 5448.365425] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5457.220834] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5457.234560] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5457.253485] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5457.256690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5457.280089] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5458.338149] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5458.354555] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5458.362702] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5458.368354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.374105] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5459.207874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.158368] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5460.162805] Lustre: Skipped 1 previous similar message [ 5460.182050] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5460.188035] Lustre: Skipped 1 previous similar message [ 5460.190789] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5460.194974] Lustre: Skipped 1 previous similar message [ 5460.197316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.202804] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5460.213467] Lustre: Skipped 1 previous similar message [ 5460.865109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.840100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.669745] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5462.673377] Lustre: Skipped 2 previous similar messages [ 5462.695332] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5462.716181] Lustre: Skipped 2 previous similar messages [ 5462.721043] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5462.731419] Lustre: Skipped 2 previous similar messages [ 5462.735787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.747530] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5462.750178] Lustre: Skipped 2 previous similar messages [ 5463.791647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.806288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.820987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.734758] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5466.737584] Lustre: Skipped 3 previous similar messages [ 5466.751972] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5466.761309] Lustre: Skipped 3 previous similar messages [ 5466.764950] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5466.768691] Lustre: Skipped 3 previous similar messages [ 5466.774792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.790037] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5466.797460] Lustre: Skipped 3 previous similar messages [ 5467.975741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.269222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.255920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.641417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.880320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.637731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.760573] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5475.775728] Lustre: Skipped 6 previous similar messages [ 5475.804640] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5475.832348] Lustre: Skipped 6 previous similar messages [ 5475.834668] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5475.841444] Lustre: Skipped 6 previous similar messages [ 5475.855051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.877462] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5475.883221] Lustre: Skipped 6 previous similar messages [ 5476.940033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.024585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5479.185344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.270496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.271149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.294205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.275562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.243466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.109953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.229501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.210510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.227308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.185272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.976455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.841443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.694662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.578566] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5492.586333] Lustre: Skipped 16 previous similar messages [ 5492.613706] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5492.625952] Lustre: Skipped 16 previous similar messages [ 5492.634714] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5492.644395] Lustre: Skipped 16 previous similar messages [ 5492.647178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.662131] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5492.667971] Lustre: Skipped 16 previous similar messages [ 5493.634478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.583954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.496547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.466053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.014289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.706370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.518913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.220082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.090375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.072182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.224103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.325577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.652238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.846300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.088697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.638445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.179666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.381391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.354180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.175408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.084175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.019424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.966182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.166063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.148903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.276738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.571657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.771419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.866970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.717738] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5524.722586] Lustre: Skipped 29 previous similar messages [ 5524.736715] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5524.746605] Lustre: Skipped 29 previous similar messages [ 5524.753694] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5524.758789] Lustre: Skipped 29 previous similar messages [ 5524.762262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.778894] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5524.781640] Lustre: Skipped 29 previous similar messages [ 5525.767343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.797633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.859202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.948828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.923773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.090744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.982524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.088405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.083142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.229697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.226793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.189642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.023884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.011060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.128920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.242317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.351493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.270525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.101122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.024327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.812964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.797552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.727773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.729494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.614423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.741782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.803336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.718996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.741292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.673499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.595157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.586352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.683917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.620635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.564872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.512391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.578261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.393106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.200376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.987516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.693761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.431294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.130038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.920808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.709209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.423917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.195179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.024205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.040891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.832911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.606454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.622141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.332557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.102503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.920666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.962050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.006346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.916492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.925046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.822398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.707413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.542731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.395579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.170212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.039905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.993389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.018468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.966493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.874665] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5588.881544] Lustre: Skipped 68 previous similar messages [ 5588.897750] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5588.904391] Lustre: Skipped 68 previous similar messages [ 5588.906980] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5588.911461] Lustre: Skipped 68 previous similar messages [ 5588.914543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.920610] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5588.930251] Lustre: Skipped 68 previous similar messages [ 5589.807225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.716835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.478405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.304262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.330780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.318069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.088403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.940426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.121583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.378753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.125117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.159131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.010860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.937719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.708501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.709340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.589371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.393949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.211057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.332281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.212923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.242687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.422857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.757404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.046487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.307801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.508541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.575330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.710173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.768825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.690945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.629398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.573413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.571091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.536446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.353983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.490520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.700872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.869699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.806037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.815906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.501418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.173567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.996302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.950161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.770313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.575402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.550298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.296288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.035082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.751751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.519252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.419610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.315673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.292927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.247982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.081725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.987359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.779842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.549461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.457624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.275865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.244294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.095758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.037274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.167765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.286782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.185156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.091324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.966509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.870388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.785193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.770646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.738044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.670442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.641275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.650426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.472937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.425306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.186650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.066111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.850406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.704738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5667.584765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.565082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.486159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.487916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.545946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.422160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.316299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.341811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.379339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.332855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.359367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.125738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.989648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.789265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.750503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.766058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5682.660948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.531185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.456818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.207670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.151377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.191240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.212043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.295931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.187204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.074812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.143058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.195066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.958434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.049129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.042801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.220733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.010462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.936392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.104397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.926435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.000651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.723037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.676713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.730039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.917755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.854885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.897599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.835810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.917149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.178592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.451577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.640055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.783843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.259701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.593158] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5717.597507] Lustre: Skipped 133 previous similar messages [ 5717.609784] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5717.616966] Lustre: Skipped 133 previous similar messages [ 5717.620142] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5717.625305] Lustre: Skipped 133 previous similar messages [ 5717.631637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.658258] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5717.664313] Lustre: Skipped 133 previous similar messages [ 5718.760725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.969737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.726660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.883331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.539174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.738963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.383254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5726.401055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.402661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.485908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.402558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.511134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.446652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.138965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.948644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.916557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.670554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.362645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.299808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.217813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.226646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.014969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.943235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.876712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.614064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.397686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.439627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.352362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.171621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.952036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.768821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.265981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.105358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.960523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.881263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.722305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.695099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.942938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.007750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.032679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.000803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.995431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.851609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5758.773192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.715980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.583030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.576842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5762.563534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5763.295611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.153991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.988507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5765.813138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5766.574777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.395935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.343207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.268624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.097452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.011292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.826800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5772.710524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5773.529545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.263460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.251757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.102703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.026208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.927688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.893250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.891224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.799368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5781.592550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.427930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.610263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.800774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.039324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.867186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.974979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5788.823305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5789.839840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.676254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.467159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.682175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.509724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.492648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5795.339886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.182222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.129620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.085839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.794204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.651978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.478314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.371077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.062816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.929211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5803.773075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.805136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.826935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.846325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.689535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5808.538967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.435828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.127968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.109776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.912316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.602411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.498266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5814.355031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.336525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.440535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.420453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.413717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.273871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.284794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.231451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.263651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.132579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.092226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.001568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.119589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.027323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.947607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.928872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5829.721377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.618320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.377761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5832.383164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.022864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.325711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.265233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.389754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.494148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5838.585817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.666915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5840.592651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.538473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.668651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.726530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.819535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.744284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.682195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.616247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.696661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.709626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.688185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5851.385201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.181208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.199625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.083256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.841278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.554266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5856.170974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.102261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.961682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.031537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.999229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.828512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.526236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.450559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5863.231443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5863.908668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.690853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5865.632593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.301303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5867.245776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.142457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5869.281361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.132131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5871.201892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.004858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.850741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.503588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.278187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.973707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.900206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5876.617215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.384276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5878.042811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5878.770676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.434597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5880.244288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.153482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.956605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.981038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5884.052342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.022352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.820177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.643699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.575675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5888.479249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.600239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.695779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.702800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.439781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5893.373242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.094928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.050286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.555246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5897.345366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.065050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.796608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.975582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.350844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.981559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.928428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.226699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5905.227273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.265568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.403241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.063562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.509767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5912.082630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.348210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.639564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5915.799912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5917.204992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.259726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5919.716410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.156152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.448965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.279329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.248717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.902731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.999919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.218320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.265280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.018780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.817989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5930.805633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.738296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5932.705689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.548642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.322023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.122631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5936.148475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.316560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.090985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.990318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.679756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.480978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.291947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.307912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.316387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.350788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.507440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5946.469529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.424560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.651924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5949.680541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.731985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5951.733258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.697679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.660642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.555938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5955.678492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.624534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5957.607735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.504804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.536512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5960.323973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.321671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.026981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.001555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.973321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.065281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.140432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5967.199365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.255666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.177984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.225881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.439887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.204936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.340872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5974.241272] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5974.246519] Lustre: Skipped 271 previous similar messages [ 5974.268342] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5974.281929] Lustre: Skipped 271 previous similar messages [ 5974.287900] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5974.294924] Lustre: Skipped 271 previous similar messages [ 5974.301437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5974.315221] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5974.325552] Lustre: Skipped 271 previous similar messages [ 5975.506381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.507834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.348743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.188472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.279085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.140974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.057674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.053724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.046676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.244562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5985.175523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.178111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.104536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.308603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.340715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.221422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.207416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.160119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.085774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.987375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.995973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5995.906121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.790830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5997.726391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.653288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5999.572568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.293022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.116524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6002.162116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.270140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.217476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6005.216966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.264281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.297762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6008.358478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.221587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.147585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.933214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.964439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.645764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.845182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6014.685460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.663338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.499913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.501660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6018.515177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.386262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.267338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.034615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.017970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.957830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6023.861746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.667252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.593560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.612222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.715308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.699555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.629262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6030.335353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.232081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.968251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.983467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.847516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.829253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.712892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.673654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.512359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6038.710420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.925523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.023855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.105646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.879827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.117263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.909349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.106829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.382220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.205534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.052240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.910820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.265907] LustreError: 172125:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6051.279866] LustreError: 172125:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6051.313619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6052.718549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.296184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.485516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.363539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.621979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.907197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.228115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.406616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.522316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.743702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.444104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.653982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.081470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.375309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.502057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.827714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.781808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.170091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6076.082599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.189668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.762842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6079.856793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.136455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.332602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.629461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.421789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.971722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.724814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.716869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6089.694239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.522291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.340425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.368724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.864704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.144315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.785338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6097.266873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.209835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6099.160065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.088711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.313934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.223298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.311097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6104.236086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.152644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.039544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.737578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.685610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.665137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.353746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.160866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.094265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.074489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.809457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6113.759625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.392988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.069338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.890233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6116.529913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.358922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.095361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.832560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.858089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.863071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.893248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.849741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.787902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.102986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.308717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.650935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.093535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6130.225853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.485528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6132.651954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.543557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6134.915898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6135.995544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6137.310285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6138.781894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.284542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.780816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6142.734255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.826889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6145.117882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6146.378097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6147.312071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.433807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.309484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6150.389508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.426067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.445749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6153.266738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.185775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.191721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.962723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6156.696716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6157.420306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.196851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.130203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6160.024527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6161.038274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.013845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.806571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.904209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6164.665225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.447738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.533040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.734602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6168.858929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.415231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.437547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.460226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6172.361649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.402256] LustreError: 172125:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -108 [ 6173.415516] LustreError: 172125:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -108 [ 6173.419762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6174.382300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6175.607369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.598687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.294037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6178.065511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6179.041482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6179.937753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6180.996901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6182.096296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6183.157334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6184.102819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6185.016083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.013197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6187.222453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.572665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6189.624498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.629490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6191.603480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6192.475474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6193.460800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6194.480363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6195.378815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6196.180819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6197.132212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6198.049614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.072346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.934601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6200.849371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6201.761455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6202.863974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6203.974594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6205.033035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.019749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.932823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6207.918508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.969268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.194197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.094080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.981408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6212.990797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6213.873868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6214.672636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6215.691064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6216.645966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6217.743780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6218.612036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6219.600724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.332472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6221.305292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6222.081397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6222.986987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6223.748657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6224.613854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.549074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6226.395469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6227.424152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.344700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.968805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6229.693980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6230.499535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6231.124774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.100528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.925063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6233.612658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6234.383145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6235.360159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6236.433917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6237.583529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.688809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6239.494292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.480379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6241.379351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.263742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6243.174551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.059620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.898805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6245.913636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6246.924366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6247.863640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6248.679985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6249.669516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6250.746885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6251.886739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6252.912235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6253.962920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6255.333780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.251138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6257.376216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6258.230683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.361108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6260.145655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6261.031961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6261.948282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6262.960732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6264.158926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6265.384187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6266.330780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.476677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6268.445163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6269.570226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6270.973389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6272.444662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6273.287957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6274.573637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6275.718466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6277.013812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6278.011075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.239331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6280.593308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6282.013786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.599089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6284.750942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6285.725309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.747965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6287.544585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6288.834522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6289.870126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6290.603875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6291.279683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.084550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.756945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6293.926393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6294.583193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6295.336774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.028482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.669701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6297.438678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6298.321627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6299.232461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6299.907625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6300.761474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6301.736101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6302.610439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6303.544695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6304.455197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6305.371223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6306.395315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6307.479296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6308.589878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6309.772365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6310.913677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6311.773132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6312.951141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6313.824169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6314.759257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6315.579272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6316.555282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6317.300974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6318.114833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6318.894678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6319.749552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6320.676995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6321.567775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6322.565340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6323.577073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.754095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6325.921069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6326.875332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6328.014203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6329.183882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6330.328258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.501219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6332.357425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6333.274985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6334.397482] LustreError: 172125:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6334.412774] LustreError: 172125:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6334.431567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6335.482085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6336.635445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6337.777512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6338.824260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6339.773312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6340.751969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6341.683092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6342.665069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6343.549143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6344.630651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6345.615932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6346.652575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6347.634451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6348.654804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6349.667144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6350.704199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6351.634741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6352.469907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6353.428630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6354.424795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6355.392439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.476451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6357.422283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6358.328677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.041641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.976733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6360.831181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6361.657284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6362.440919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6363.289779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6364.065868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6365.211242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6366.044541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6367.151147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.108163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6369.064685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6370.002334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6370.855979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6371.653087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6372.661736] LustreError: 172125:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6372.668474] LustreError: 172125:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6372.673990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6373.479253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6374.680148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6375.445805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6376.373331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6377.215809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6378.276687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6378.940572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6380.353388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6381.568955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6382.754499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6384.011522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.003975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.892782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6387.551688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6388.930693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6390.029236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6390.971578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6392.183254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.594599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6394.546182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6395.672356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6397.305451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6398.379833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6399.525172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6400.185866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6401.481482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6402.409289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6403.456911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6404.464397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6405.291097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6405.873430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6406.682724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6408.017312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6409.244266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6410.727316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.045294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.942555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6413.802798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6414.813129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6415.913639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6417.074379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6418.772940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6419.946153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6421.139168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6422.243744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.515845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6424.713689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6425.878845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6426.767321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6427.801067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6428.732335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6429.916140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6430.784035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.909877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6432.718315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6433.650360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6434.217309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6435.161117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6436.340865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.446863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6438.853260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6803.926593] LustreError: 181333:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6803.936590] LustreError: 172125:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 7234.017455] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7234.021888] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7234.033251] Lustre: Skipped 460 previous similar messages [ 7234.036784] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7236.580996] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7236.602826] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7238.630466] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7240.622746] Lustre: server umount lustre-OST0000 complete [ 7248.356590] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7248.363677] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7248.365984] Lustre: Skipped 1 previous similar message [ 7252.047523] Lustre: server umount lustre-MDT0000 complete [ 7253.990377] LustreError: 173714:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7254.006750] LustreError: 173714:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7256.634605] LustreError: 172085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788446119 with bad export cookie 3130959768291431628 [ 7256.647467] LustreError: 172085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7256.647976] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7257.055852] Lustre: server umount lustre-MDT0001 complete [ 7270.418911] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 7273.834091] Key type lgssc unregistered [ 7274.239088] LNet: 227328:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7274.255879] LNetError: 227328:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7274.282781] LNet: Removed LNI 192.168.202.126@tcp [ 7275.402746] Key type .llcrypt unregistered [ 7275.407144] Key type ._llcrypt unregistered [ 7302.307653] Key type ._llcrypt registered [ 7302.309344] Key type .llcrypt registered [ 7302.465427] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 7303.772152] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7303.974548] alg: No test for adler32 (adler32-zlib) [ 7305.012277] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 7305.307834] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 7306.961802] Key type lgssc registered [ 7308.480834] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7316.658379] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7316.681296] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7318.347956] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7323.391644] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7328.738790] LustreError: 228742:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7328.758986] LustreError: 228742:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7331.810531] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7332.312596] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7337.088969] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7344.708569] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7350.981930] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7357.434042] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7357.684702] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7363.852509] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 7364.768662] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7372.583931] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7378.158463] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 7379.779750] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7379.789556] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 7379.793362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7379.800320] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7379.800562] LustreError: 228762:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 7384.545748] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7384.558487] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7384.570721] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7384.584818] Lustre: Skipped 1 previous similar message [ 7384.606836] Lustre: Skipped 1 previous similar message [ 7385.422137] Lustre: lustre-OST0000: Not available for connect from 192.168.202.26@tcp (stopping) [ 7387.767573] Lustre: server umount lustre-OST0000 complete [ 7399.816133] LustreError: 228762:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 7422.508502] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7422.862253] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7424.966840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7424.983809] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7424.986492] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7425.005680] Lustre: Skipped 1 previous similar message [ 7430.199972] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7438.106821] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7439.835223] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 7445.946922] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a0785881800.ost_server_uuid 50 [ 7447.316130] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a0785881800.ost_server_uuid in IDLE state after 0 sec [ 7453.153808] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7453.175231] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7453.190912] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7455.725683] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7455.730408] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7455.755599] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7458.872659] Lustre: server umount lustre-OST0000 complete [ 7465.442359] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7465.456596] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7465.471186] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7465.477066] Lustre: Skipped 1 previous similar message [ 7469.402838] Lustre: server umount lustre-MDT0000 complete [ 7471.073260] LustreError: 228743:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7471.102506] LustreError: 228743:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7473.171448] LustreError: 228723:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788446336 with bad export cookie 7655881981750825701 [ 7473.174761] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7473.178556] LustreError: 228723:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7473.447689] Lustre: server umount lustre-MDT0001 complete [ 7485.905654] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 7489.843474] Key type lgssc unregistered [ 7490.239876] LNet: 233948:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7490.245422] LNetError: 233948:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7490.261167] LNet: Removed LNI 192.168.202.126@tcp [ 7491.574736] Key type .llcrypt unregistered [ 7491.576345] Key type ._llcrypt unregistered [ 7529.290307] Key type ._llcrypt registered [ 7529.293732] Key type .llcrypt registered [ 7529.435293] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 7530.610109] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7530.672130] alg: No test for adler32 (adler32-zlib) [ 7532.053369] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 7532.285597] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 7533.968450] Key type lgssc registered [ 7535.320346] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7546.021398] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7546.050199] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7547.774218] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7552.754944] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7558.116590] LustreError: 235674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7558.135843] LustreError: 235674:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7561.851570] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7562.407981] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7567.365970] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7570.910629] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7577.080647] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7577.611089] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7583.766653] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7592.988254] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 7593.354805] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7593.647649] Lustre: lustre-OST0001: new disk, initializing [ 7593.650874] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7593.656482] Lustre: 237985:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7593.753188] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7595.621292] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7595.625141] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7595.746938] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7602.129536] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7614.731279] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7621.362302] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7633.906119] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7633.916260] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7633.943948] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7634.191298] Lustre: server umount lustre-MDT0000 complete [ 7636.963275] LustreError: 236404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7636.979834] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7638.277561] LustreError: 235655:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788446501 with bad export cookie 5434090709716400291 [ 7638.294144] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7638.301930] LustreError: 235655:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7638.864512] Lustre: server umount lustre-MDT0001 complete [ 7653.758936] Lustre: server umount lustre-OST0000 complete [ 7657.440307] Lustre: 234936:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788446504/real 1788446504] req@ffff9e98631cb100 x1875321967174656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788446520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7657.469751] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7657.478114] Lustre: Skipped 2 previous similar messages [ 7658.573505] Lustre: server umount lustre-OST0001 complete [ 7681.868363] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 7694.230680] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7694.682139] LustreError: 241092:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7694.694453] LustreError: 241092:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 7694.778525] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7699.939149] LustreError: 241093:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7700.893644] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7705.068716] LustreError: 241092:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7710.370687] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7710.717130] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7716.052810] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7719.545709] Lustre: 242237:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7727.087065] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7727.466103] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7734.824840] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7735.671829] LustreError: 242990:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7735.696349] LustreError: 242990:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7739.782145] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49760) [ 7743.761583] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7752.642552] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7760.449192] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7764.352654] Lustre: 244108:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7775.201767] Lustre: mylustre-MDT0000-lwp-OST0000: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7775.218069] Lustre: Skipped 2 previous similar messages [ 7775.219751] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7775.229348] Lustre: Skipped 3 previous similar messages [ 7780.337571] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7780.344526] Lustre: Skipped 2 previous similar messages [ 7781.498211] Lustre: server umount mylustre-MDT0000 complete [ 7785.280334] LustreError: 244307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788446648 with bad export cookie 5434090709716403098 [ 7785.281055] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7785.298718] LustreError: 244307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7785.452542] Lustre: mylustre-MDT0001-lwp-OST0000: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7785.463529] LustreError: 242613:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7785.479297] Lustre: Skipped 2 previous similar messages [ 7785.490673] Lustre: mylustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7785.506293] LustreError: 242613:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 7785.519026] Lustre: Skipped 1 previous similar message [ 7785.834871] Lustre: server umount mylustre-MDT0001 complete [ 7792.397354] Lustre: server umount mylustre-OST0000 complete [ 7796.333410] Lustre: server umount mylustre-OST0001 complete [ 7820.516853] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 7831.876264] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7832.440194] LustreError: 246415:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7832.538607] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7832.541930] Lustre: Skipped 1 previous similar message [ 7837.443894] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7846.406611] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7851.967376] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7855.277797] Lustre: 247556:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7863.490326] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7870.279238] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7878.721616] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49792) [ 7879.541188] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7885.336298] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 7887.158877] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7894.821549] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7898.383531] Lustre: 249430:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7905.763369] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7905.784347] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7905.791821] Lustre: Skipped 3 previous similar messages [ 7905.803034] Lustre: Skipped 3 previous similar messages [ 7910.858441] Lustre: server umount tfs-MDT0000 complete [ 7910.901240] LustreError: 246415:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7910.937475] LustreError: 246415:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 9 previous similar messages [ 7914.331453] LustreError: 246392:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788446777 with bad export cookie 5434090709716404764 [ 7914.338392] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7914.751185] Lustre: server umount tfs-MDT0001 complete [ 7928.787067] Lustre: server umount tfs-OST0000 complete [ 7931.366357] Lustre: 234936:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788446778/real 1788446778] req@ffff9e9860f01880 x1875321967286528/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788446794 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7931.404953] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7932.804311] Lustre: server umount tfs-OST0001 complete [ 7956.569412] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 7967.701549] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7968.216616] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7968.222542] Lustre: Skipped 3 previous similar messages [ 7973.548982] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7983.706629] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7989.589822] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 7992.806181] Lustre: 252821:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7999.471230] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8006.813566] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8014.156204] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49824) [ 8014.900778] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8020.469729] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 8021.406176] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8028.661365] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8032.087867] Lustre: 254692:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8038.928753] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 10:48:19 (1788446899) [ 8056.292843] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8056.298910] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8056.302985] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8056.308662] Lustre: Skipped 2 previous similar messages [ 8056.321640] Lustre: Skipped 3 previous similar messages [ 8061.545595] Lustre: server umount lustre-MDT0000 complete [ 8065.145468] LustreError: 251657:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788446928 with bad export cookie 5434090709716406430 [ 8065.150171] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8065.152229] LustreError: 251657:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 8066.529493] LustreError: 251676:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8066.556813] LustreError: 251676:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 8 previous similar messages [ 8071.676499] Lustre: server umount lustre-MDT0001 complete [ 8090.080117] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8090.174664] Lustre: server umount lustre-OST0000 complete [ 8100.265759] Lustre: server umount lustre-OST0001 complete [ 8108.056347] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 8119.028479] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 8151.924108] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8152.169984] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8152.193258] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8152.337802] Lustre: lustre-MDT0000: new disk, initializing [ 8152.457944] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 188-180 [ 8152.462866] Lustre: Skipped 3 previous similar messages [ 8152.476229] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8156.480938] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8167.088595] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8167.228771] Lustre: 257880:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8167.283713] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8167.288829] Lustre: Skipped 1 previous similar message [ 8167.369471] Lustre: lustre-MDT0001: new disk, initializing [ 8167.480279] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8167.500736] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8173.179070] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8185.206504] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8185.586200] Lustre: lustre-OST0000: new disk, initializing [ 8185.591583] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8185.602733] Lustre: 259462:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8186.952021] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8186.955925] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8187.084476] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8192.214165] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8203.545910] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8203.773895] Lustre: lustre-OST0001: new disk, initializing [ 8203.779285] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8203.785772] Lustre: 260337:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8205.087270] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8205.133639] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8205.332451] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8211.107490] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8223.296587] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 10:51:24 (1788447084) [ 8238.909297] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 10:51:39 (1788447099) [ 8254.437614] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8254.449067] Lustre: Skipped 4 previous similar messages [ 8254.469790] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8254.481523] Lustre: Skipped 9 previous similar messages [ 8260.555724] Lustre: server umount lustre-OST0000 complete [ 8264.681585] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8270.739416] Lustre: server umount lustre-MDT0000 complete [ 8274.987365] LustreError: 257874:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788447137 with bad export cookie 5434090709716407984 [ 8275.004615] LustreError: 257874:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8275.013383] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8281.460734] Lustre: server umount lustre-MDT0001 complete [ 8291.507293] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 8368.011674] Lustre: server umount lustre-OST0001 complete [ 8375.344760] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 8392.380380] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 8427.552654] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8427.772637] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8427.794832] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8427.866299] Lustre: lustre-MDT0000: new disk, initializing [ 8427.921457] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8427.926240] Lustre: Skipped 3 previous similar messages [ 8427.935832] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8432.134033] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8441.941141] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8442.011184] Lustre: 265189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8442.197329] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8446.322900] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8455.160465] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8461.026649] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8467.325341] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8467.528259] Lustre: lustre-OST0000: new disk, initializing [ 8467.530730] Lustre: Skipped 1 previous similar message [ 8467.533916] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8467.542087] Lustre: Skipped 2 previous similar messages [ 8467.546868] Lustre: 267156:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8469.251306] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8469.257902] Lustre: Skipped 1 previous similar message [ 8469.263368] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8469.395493] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8473.723369] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8483.765639] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8489.956886] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8489.975450] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8489.976464] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8489.986477] Lustre: Skipped 5 previous similar messages [ 8490.022953] Lustre: Skipped 10 previous similar messages [ 8496.163967] Lustre: server umount lustre-OST0000 complete [ 8503.781179] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8506.696559] Lustre: server umount lustre-MDT0000 complete [ 8510.360514] LustreError: 265181:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788447373 with bad export cookie 5434090709716409454 [ 8510.368867] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8510.369940] LustreError: 265181:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 8510.642395] Lustre: server umount lustre-MDT0001 complete [ 8524.200898] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 8528.073526] Key type lgssc unregistered [ 8528.472987] LNet: 268915:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8528.480123] LNetError: 268915:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8528.512528] LNet: Removed LNI 192.168.202.126@tcp [ 8529.884637] Key type .llcrypt unregistered [ 8529.887706] Key type ._llcrypt unregistered [ 8562.070223] Key type ._llcrypt registered [ 8562.071765] Key type .llcrypt registered [ 8562.246425] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 8563.653498] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8563.998695] alg: No test for adler32 (adler32-zlib) [ 8565.386826] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 8565.827891] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 8567.752221] Key type lgssc registered [ 8569.275043] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8578.173787] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8578.199596] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8579.692757] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8584.126373] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8589.289854] LustreError: 270377:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8589.305058] LustreError: 270377:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 8592.331330] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8592.781991] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8597.417604] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8604.990774] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8611.363917] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8618.273893] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8618.718050] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8625.197317] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8625.922279] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 8633.921288] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8635.108404] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 8638.190037] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8638.190600] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8643.446317] Lustre: server umount lustre-OST0000 complete [ 8648.681085] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8648.694871] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8648.708348] Lustre: Skipped 1 previous similar message [ 8648.724644] Lustre: Skipped 2 previous similar messages [ 8653.505159] Lustre: server umount lustre-MDT0000 complete [ 8653.796621] LustreError: 270377:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8653.817029] LustreError: 270377:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8657.150075] LustreError: 270357:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788447520 with bad export cookie 14474697274509817476 [ 8657.152302] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8657.160268] LustreError: 270357:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8657.513462] Lustre: server umount lustre-MDT0001 complete [ 8669.474188] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 8672.469332] Key type lgssc unregistered [ 8672.751715] LNet: 273960:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8672.760197] LNetError: 273960:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8672.768981] LNet: Removed LNI 192.168.202.126@tcp [ 8673.620618] Key type .llcrypt unregistered [ 8673.624400] Key type ._llcrypt unregistered [ 8696.635908] Key type ._llcrypt registered [ 8696.637994] Key type .llcrypt registered [ 8696.800553] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 8698.913490] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8699.503199] alg: No test for adler32 (adler32-zlib) [ 8700.770472] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 8701.055709] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 8702.752175] Key type lgssc registered [ 8704.287968] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8715.249522] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8715.279624] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8730.976530] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 8736.098180] LustreError: 275155:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.126@tcp: failed processing log, type 4: rc = -110 [ 8762.786421] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8771.202934] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 8780.805875] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8783.244748] Lustre: server umount lustre-OST0000 complete [ 8802.378166] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 8806.734938] Key type lgssc unregistered [ 8807.506892] LNet: 276797:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8807.524392] LNetError: 276797:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8807.582161] LNet: Removed LNI 192.168.202.126@tcp [ 8809.288624] Key type .llcrypt unregistered [ 8809.292622] Key type ._llcrypt unregistered [ 8857.547406] Key type ._llcrypt registered [ 8857.550913] Key type .llcrypt registered [ 8857.730715] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 8859.611789] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8860.069284] alg: No test for adler32 (adler32-zlib) [ 8861.232958] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 8861.600498] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 8863.296384] Key type lgssc registered [ 8864.429952] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8877.450242] loop0: detected capacity change from 0 to 204800000 [ 8877.662213] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8877.687643] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8878.022952] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8879.170568] loop0: detected capacity change from 0 to 204800000 [ 8879.381757] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8879.406285] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8879.662749] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8880.828911] loop0: detected capacity change from 0 to 204800000 [ 8881.006568] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8881.017662] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8881.112864] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8882.134953] loop0: detected capacity change from 0 to 204800000 [ 8882.344261] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8883.682387] loop0: detected capacity change from 0 to 204800000 [ 8883.711229] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8888.110605] loop0: detected capacity change from 0 to 204800000 [ 8888.162957] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8892.625847] loop0: detected capacity change from 0 to 204800000 [ 8892.675125] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8897.558876] loop0: detected capacity change from 0 to 204800000 [ 8897.597941] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8902.053485] loop0: detected capacity change from 0 to 204800000 [ 8902.135246] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8902.211649] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8902.313455] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8902.336931] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 8902.351885] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8902.368483] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 8902.383813] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8902.397651] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 8902.404313] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8902.412416] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 8902.422702] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 8902.440799] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 8902.463133] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 8902.473601] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 8902.486873] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 8902.495697] Lustre: 280209:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8908.732569] Lustre: server umount MGS complete [ 8909.743410] loop0: detected capacity change from 0 to 204800000 [ 8909.833584] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8910.441796] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8910.486589] Lustre: lustre-MDT0000: Aborting client recovery [ 8911.419025] loop1: detected capacity change from 0 to 204800000 [ 8911.586932] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8911.728438] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8911.749299] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8911.774633] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8911.799897] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8911.818550] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8911.839712] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8911.862162] Lustre: 280644:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8911.938743] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8912.222154] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8912.298097] Lustre: lustre-MDT0001: Aborting client recovery [ 8913.300837] loop2: detected capacity change from 0 to 204800000 [ 8913.578401] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8913.667565] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8913.682513] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8913.697838] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8913.710601] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8913.731771] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8913.741077] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8913.764775] Lustre: 280723:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8913.926211] Lustre: Found index 0 for lustre-OST0000, updating log [ 8914.005409] Lustre: 280741:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8914.093730] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8914.121482] Lustre: lustre-OST0000: Aborting recovery [ 8915.155841] loop3: detected capacity change from 0 to 204800000 [ 8915.399175] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8915.512785] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8915.524723] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8915.535412] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8915.563175] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8915.592954] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8915.603149] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8915.621909] Lustre: 280806:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8915.658308] Lustre: Found index 1 for lustre-OST0001, updating log [ 8915.717968] Lustre: 280813:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8915.882437] Lustre: lustre-OST0001: Aborting recovery [ 8920.999686] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8921.022534] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8921.040140] LustreError: 280587:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 8921.076550] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8921.163116] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8922.021923] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8923.059512] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8925.328729] LustreError: 280554:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 471us: rc = -2 [ 8925.835042] LustreError: 280554:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 1772us: rc = -2 [ 8925.860611] LustreError: 280554:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 17 previous similar messages [ 8943.073120] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8943.087797] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8943.115183] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8943.599195] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8943.624088] Lustre: Skipped 2 previous similar messages [ 8943.632183] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8943.634831] Lustre: Skipped 2 previous similar messages [ 8945.069968] Lustre: server umount lustre-MDT0000 complete [ 8946.187747] LustreError: 280536:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788447809 with bad export cookie 2758132504090833628 [ 8946.211745] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8946.225887] LustreError: 280536:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8948.705124] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8948.708152] LustreError: 280551:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8948.716642] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8948.721130] Lustre: Skipped 1 previous similar message [ 8948.766755] LustreError: 280551:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 8951.713314] LustreError: 280552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8951.715251] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8951.727560] LustreError: 280552:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8951.736595] Lustre: Skipped 2 previous similar messages [ 8952.602873] Lustre: server umount lustre-MDT0001 complete [ 8959.844483] Lustre: server umount lustre-OST0000 complete [ 8967.179314] Lustre: server umount lustre-OST0001 complete [ 8975.516171] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 11:03:56 (1788447836) [ 9013.200934] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 9025.109634] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 9072.462448] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9072.783455] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9072.811544] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9072.957136] Lustre: lustre-MDT0000: new disk, initializing [ 9073.087910] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9073.097575] Lustre: Skipped 1 previous similar message [ 9073.147479] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9079.404577] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9090.490688] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9090.691187] Lustre: 284884:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9090.760911] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9090.765168] Lustre: Skipped 1 previous similar message [ 9090.860401] Lustre: lustre-MDT0001: new disk, initializing [ 9091.000411] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9091.042192] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9091.054316] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9097.073472] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9109.756878] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9117.733800] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9125.985382] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9126.199843] Lustre: lustre-OST0000: new disk, initializing [ 9126.205643] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9126.215228] Lustre: 286852:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9126.339835] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9133.269052] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9133.290535] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9133.465869] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9133.882847] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9144.738670] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9150.883743] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9160.296995] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9166.303516] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9210.347215] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9210.349399] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9210.363186] LustreError: Skipped 1 previous similar message [ 9210.369305] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9210.384211] Lustre: Skipped 1 previous similar message [ 9210.422668] Lustre: Skipped 1 previous similar message [ 9220.595713] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9220.603095] Lustre: Skipped 3 previous similar messages [ 9222.112186] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9222.419582] Lustre: server umount lustre-OST0000 complete [ 9229.284993] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9229.292248] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9233.534654] Lustre: server umount lustre-MDT0000 complete [ 9235.938579] LustreError: 284890:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9235.970981] LustreError: 284890:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9237.460831] LustreError: 288466:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448100 with bad export cookie 2758132504090836337 [ 9237.473272] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9237.488623] LustreError: 288466:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9237.874684] Lustre: server umount lustre-MDT0001 complete [ 9246.143650] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9251.146407] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9256.580423] Lustre: server umount MGS complete [ 9270.092243] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9270.562489] LustreError: 290673:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9270.592281] LustreError: 290686:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9270.677592] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9275.597562] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9275.879171] LustreError: 290674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9284.692671] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9288.699689] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9296.949345] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9304.419630] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9314.911037] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9315.667993] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9315.681293] Lustre: Skipped 1 previous similar message [ 9321.314685] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9329.330962] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9360.866652] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9360.883835] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9360.888751] Lustre: Skipped 2 previous similar messages [ 9360.893119] Lustre: Skipped 3 previous similar messages [ 9374.176126] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9374.444849] Lustre: server umount lustre-OST0000 complete [ 9381.346741] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9381.354521] Lustre: Skipped 1 previous similar message [ 9393.121714] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9393.329646] Lustre: server umount lustre-MDT0000 complete [ 9396.745171] LustreError: 291402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9396.765337] LustreError: 291402:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 9397.937848] LustreError: 290655:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448260 with bad export cookie 2758132504090838171 [ 9397.945322] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9397.948281] LustreError: 290655:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9398.389699] Lustre: server umount lustre-MDT0001 complete [ 9411.655423] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 9414.715840] Key type lgssc unregistered [ 9415.114797] LNet: 294622:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9415.119248] LNetError: 294622:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9415.143019] LNet: Removed LNI 192.168.202.126@tcp [ 9416.179123] Key type .llcrypt unregistered [ 9416.184934] Key type ._llcrypt unregistered [ 9458.346620] Key type ._llcrypt registered [ 9458.348660] Key type .llcrypt registered [ 9458.479408] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 9478.419572] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 9479.756316] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9479.854172] alg: No test for adler32 (adler32-zlib) [ 9480.978809] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 9481.222693] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 9482.984162] Key type lgssc registered [ 9484.526076] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9526.140332] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9526.183868] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9527.491663] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9527.517809] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9527.607129] Lustre: lustre-MDT0000: new disk, initializing [ 9527.695837] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9527.719113] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9533.630953] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9545.339696] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9545.556606] Lustre: 298580:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9545.633036] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9545.635695] Lustre: Skipped 1 previous similar message [ 9545.784540] Lustre: lustre-MDT0001: new disk, initializing [ 9545.925862] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9545.964857] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9545.973193] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9551.366438] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9562.352879] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9568.349508] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9574.821948] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9575.199779] Lustre: lustre-OST0000: new disk, initializing [ 9575.211469] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9575.225391] Lustre: 300545:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9575.407184] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9583.780082] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9584.397340] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9584.409723] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9584.651599] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9597.506793] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9605.224659] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9616.974513] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9624.192587] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9628.794680] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 9666.529557] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9666.544412] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9666.567685] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9666.580620] Lustre: Skipped 1 previous similar message [ 9671.718377] Lustre: server umount lustre-OST0000 complete [ 9676.772637] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9676.805535] Lustre: Skipped 1 previous similar message [ 9676.816699] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9676.823828] Lustre: Skipped 1 previous similar message [ 9681.891440] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9681.906441] Lustre: Skipped 1 previous similar message [ 9682.815653] Lustre: server umount lustre-MDT0000 complete [ 9686.746971] LustreError: 301401:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448549 with bad export cookie 14925647145540627814 [ 9686.749245] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9686.766015] LustreError: 301401:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9687.168090] Lustre: server umount lustre-MDT0001 complete [ 9697.650756] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9703.583314] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9710.607951] Lustre: server umount MGS complete [ 9725.315370] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9726.039797] LustreError: 304378:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9726.206247] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9731.420411] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9731.554368] LustreError: 304366:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9731.570505] LustreError: 304366:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 9735.649978] LustreError: 304365:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9740.769917] LustreError: 304366:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9741.381045] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9742.037890] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9747.227911] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9755.987380] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9762.075460] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9769.384544] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9769.686935] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9775.625081] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9785.190093] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9817.057670] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9817.070653] LustreError: Skipped 1 previous similar message [ 9817.084160] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9817.103654] Lustre: Skipped 1 previous similar message [ 9817.110600] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9818.083623] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9823.204993] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9823.219980] Lustre: Skipped 3 previous similar messages [ 9829.345136] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9829.503299] Lustre: server umount lustre-OST0000 complete [ 9833.443604] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9833.449483] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9833.456161] Lustre: Skipped 2 previous similar messages [ 9833.482512] Lustre: Skipped 3 previous similar messages [ 9839.594493] Lustre: server umount lustre-MDT0000 complete [ 9843.689478] LustreError: 304366:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9843.721433] LustreError: 304366:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9843.915991] LustreError: 306212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448706 with bad export cookie 14925647145540629641 [ 9843.922935] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9843.925686] LustreError: 306212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9844.351786] Lustre: server umount lustre-MDT0001 complete [ 9857.594686] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [ 9860.277707] Key type lgssc unregistered [ 9860.685911] LNet: 308314:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9860.697062] LNetError: 308314:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9860.727812] LNet: Removed LNI 192.168.202.126@tcp [ 9861.660754] Key type .llcrypt unregistered [ 9861.667132] Key type ._llcrypt unregistered [ 9884.434652] Key type ._llcrypt registered [ 9884.437358] Key type .llcrypt registered [ 9884.557297] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [ 9899.020092] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 9900.060326] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9900.314815] alg: No test for adler32 (adler32-zlib) [ 9901.421805] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [ 9901.622249] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [ 9903.256177] Key type lgssc registered [ 9904.665899] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9928.013801] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [ 9943.082553] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9943.147161] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9944.477938] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9944.538223] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9944.681269] Lustre: lustre-MDT0000: new disk, initializing [ 9944.758474] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9944.777460] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9948.995919] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [ 9959.750860] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9960.169912] Lustre: lustre-OST0000: new disk, initializing [ 9960.173804] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9960.178842] Lustre: Skipped 1 previous similar message [ 9960.211594] Lustre: 312359:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9960.348646] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9966.213547] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 9966.222777] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 9966.272881] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9968.036840] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [10759.651339] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10759.682719] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10762.203343] Lustre: server umount lustre-MDT0000 complete [10766.173346] LustreError: 311549:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788449629 with bad export cookie 8216354382979114120 [10766.183162] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10766.184990] LustreError: 311549:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [10766.527283] Lustre: server umount lustre-OST0000 complete [10793.647770] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [10806.545997] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [10848.961927] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10849.278640] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10849.305751] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10849.448833] Lustre: lustre-MDT0000: new disk, initializing [10849.578190] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10849.608635] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10855.476130] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [10866.930271] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10867.133774] Lustre: 316692:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10867.237427] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10867.244448] Lustre: Skipped 1 previous similar message [10867.356906] Lustre: lustre-MDT0001: new disk, initializing [10867.518943] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10867.566717] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10867.585407] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10872.875514] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [10883.203466] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10889.161557] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10895.635673] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10895.869414] Lustre: lustre-OST0000: new disk, initializing [10895.874903] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10895.881983] Lustre: 318658:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10895.943048] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10901.605147] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10901.618284] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10901.761634] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10902.616408] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [10912.754512] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10918.819468] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10919.074976] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10924.862963] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10925.137388] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10927.585306] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10927.585981] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10927.591334] LustreError: Skipped 1 previous similar message [10927.592501] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10927.628473] Lustre: Skipped 1 previous similar message [10932.720070] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10932.728105] Lustre: Skipped 2 previous similar messages [10933.727919] Lustre: server umount lustre-OST0000 complete [10939.382880] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10939.392439] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10939.421056] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10942.952122] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10944.336995] Lustre: server umount lustre-MDT0000 complete [10947.887797] LustreError: 316682:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788449810 with bad export cookie 8216354382982054939 [10947.897128] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10947.906688] LustreError: 316682:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10948.311802] Lustre: server umount lustre-MDT0001 complete [10951.662298] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [10953.361219] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 11:36:54 (1788449814) [10959.848938] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10960.243727] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10964.768885] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [10965.474177] LustreError: 320973:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10965.487962] LustreError: 320973:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10970.595035] LustreError: 320974:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10974.253467] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10974.657254] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10979.466693] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [10987.550239] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10993.465670] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11001.347500] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11001.790148] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11009.230618] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11017.073354] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11025.326457] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11025.543337] Lustre: lustre-OST0001: new disk, initializing [11025.554246] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [11025.558563] Lustre: 323809:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11025.668563] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11032.255574] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [11032.266502] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [11032.345369] LustreError: 324102:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11032.356377] LustreError: 324102:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [11033.386616] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11034.477174] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11034.505893] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [11034.556836] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11036.551667] LustreError: 324102:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11036.586186] LustreError: 324102:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [11040.808037] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11040.822751] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [11048.155541] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11048.509886] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11049.192275] LustreError: 324102:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11049.208974] LustreError: 324102:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [11055.523281] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a0787ea7000.ost_server_uuid 50 [11057.705938] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a0787ea7000.ost_server_uuid in FULL state after 0 sec [11063.678606] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8a0787ea7000.ost_server_uuid 50 [11065.003399] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8a0787ea7000.ost_server_uuid in IDLE state after 0 sec [11065.636500] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11065.651640] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 32 previous similar messages [11066.730616] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [11082.210064] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11082.220108] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11082.221843] LustreError: Skipped 1 previous similar message [11082.237359] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11082.250108] Lustre: Skipped 1 previous similar message [11082.287195] Lustre: Skipped 3 previous similar messages [11087.665978] LustreError: 322792:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.202.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11087.732755] Lustre: server umount lustre-OST0001 complete [11094.019215] LustreError: 322793:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11094.042114] LustreError: 322793:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [11096.033569] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11096.040201] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11096.053329] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11096.066253] Lustre: Skipped 3 previous similar messages [11100.797993] Lustre: server umount lustre-OST0000 complete [11111.522189] Lustre: server umount lustre-MDT0000 complete [11112.423123] LustreError: 320973:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11112.466412] LustreError: 320973:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [11115.038718] LustreError: 320955:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788449977 with bad export cookie 8216354382982055821 [11115.041937] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11115.045566] LustreError: 320955:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11115.441152] Lustre: server umount lustre-MDT0001 complete [11126.680912] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [11129.687903] Key type lgssc unregistered [11130.091854] LNet: 326498:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11130.096576] LNetError: 326498:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11130.109527] LNet: Removed LNI 192.168.202.126@tcp [11131.298176] Key type .llcrypt unregistered [11131.300344] Key type ._llcrypt unregistered [11159.118790] Key type ._llcrypt registered [11159.122175] Key type .llcrypt registered [11159.297438] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [11160.543323] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11160.574484] alg: No test for adler32 (adler32-zlib) [11161.849561] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [11162.091925] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [11163.744290] Key type lgssc registered [11165.205803] Lustre: Echo OBD driver; http://www.lustre.org/ [11173.498564] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11173.539526] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11175.058594] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11179.779920] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11184.632850] LustreError: 327917:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11184.648419] LustreError: 327917:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [11187.240456] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11189.732653] LustreError: 327916:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11193.362880] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11193.901187] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11197.544531] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11206.297374] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11206.649589] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11212.487566] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11218.926627] LustreError: 329595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11219.974975] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [11220.128315] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11225.071409] LustreError: 330218:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11225.098294] LustreError: 330218:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [11225.998282] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11226.284151] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11231.302421] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11231.744092] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [11238.585603] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11244.360766] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [11244.601779] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11349.476436] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11349.481605] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11349.486018] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11349.489977] Lustre: Skipped 1 previous similar message [11349.505616] Lustre: Skipped 1 previous similar message [11350.743338] Lustre: server umount lustre-OST0001 complete [11354.614474] LustreError: 329597:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11354.625022] LustreError: 329597:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11357.153351] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11357.161246] LustreError: Skipped 1 previous similar message [11357.164189] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11357.174257] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11358.183934] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11358.193298] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11358.207805] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11362.891132] Lustre: server umount lustre-OST0000 complete [11367.906867] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11367.921568] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11367.930898] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11367.935375] Lustre: Skipped 2 previous similar messages [11372.417652] Lustre: server umount lustre-MDT0000 complete [11375.078221] LustreError: 327917:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11375.089798] LustreError: 327917:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [11375.458701] LustreError: 327898:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788450238 with bad export cookie 12199673691889371751 [11375.472645] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11375.481019] LustreError: 327898:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11375.740644] Lustre: server umount lustre-MDT0001 complete [11385.479517] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [11387.613476] Key type lgssc unregistered [11387.830715] LNet: 332854:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11387.835109] LNetError: 332854:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11388.907472] LNet: Removed LNI 192.168.202.126@tcp [11389.524349] Key type .llcrypt unregistered [11389.527248] Key type ._llcrypt unregistered [11428.028578] Key type ._llcrypt registered [11428.032198] Key type .llcrypt registered [11428.124253] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [11429.044534] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11429.107270] alg: No test for adler32 (adler32-zlib) [11430.187408] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [11430.425479] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [11432.080211] Key type lgssc registered [11433.058289] Lustre: Echo OBD driver; http://www.lustre.org/ [11441.296454] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11441.313884] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11442.783730] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11447.015885] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11452.898434] LustreError: 335145:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11452.909954] LustreError: 335145:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [11455.009499] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11455.339187] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11459.705675] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11462.697549] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [11469.370696] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11469.695189] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11476.252567] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11480.936033] LustreError: 336633:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11486.009861] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11486.280751] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11487.323357] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [11487.326311] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [11492.334180] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11500.991716] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11509.518713] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [11522.018921] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11522.026098] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11522.052726] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11523.046179] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11523.051352] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11523.053472] Lustre: Skipped 1 previous similar message [11523.078090] Lustre: Skipped 3 previous similar messages [11525.376736] Lustre: server umount lustre-MDT0000 complete [11528.180392] LustreError: 335139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11528.210882] LustreError: 335139:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [11528.970585] LustreError: 335124:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788450391 with bad export cookie 4274759727971085591 [11528.974493] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11528.986906] LustreError: 335124:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11529.409263] Lustre: server umount lustre-MDT0001 complete [11542.579864] Lustre: server umount lustre-OST0000 complete [11556.004496] Lustre: server umount lustre-OST0001 complete [11572.886115] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [11581.848936] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11582.171636] LustreError: 340426:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11582.252772] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11586.161819] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11587.554806] LustreError: 340427:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11595.883636] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11596.333515] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11602.861411] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11606.873380] Lustre: 341567:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [11616.971063] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11617.214650] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11621.320268] LustreError: 341922:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11621.349149] LustreError: 341922:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11624.545630] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11627.514818] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [11632.100823] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11637.776206] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [11640.559258] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11650.111595] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11654.277949] Lustre: 343439:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [11658.217365] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11658.238189] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11658.240204] Lustre: Skipped 4 previous similar messages [11658.252413] Lustre: Skipped 3 previous similar messages [11663.343039] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11663.353879] Lustre: Skipped 3 previous similar messages [11664.680429] Lustre: server umount lustre-MDT0000 complete [11668.453763] LustreError: 340427:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11668.479288] LustreError: 340427:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [11668.732777] LustreError: 340407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788450531 with bad export cookie 4274759727971087292 [11668.749130] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11668.757386] LustreError: 340407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11669.359392] Lustre: server umount lustre-MDT0001 complete [11682.909356] Lustre: server umount lustre-OST0000 complete [11697.170493] Lustre: server umount lustre-OST0001 complete [11701.126356] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [11702.739293] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [11704.588778] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 11:49:25 (1788450565) [11727.818635] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [11737.048677] loop0: detected capacity change from 0 to 1099511627776 [11737.477879] SGI XFS with ACLs, security attributes, quota, no debug enabled [11737.483850] *** VALIDATE xfs *** [11737.491686] XFS (loop0): Mounting V5 Filesystem [11737.540188] XFS (loop0): Ending clean mount [11738.942757] loop1: detected capacity change from 0 to 18691697672192 [11860.995825] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [11872.808448] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [11913.926576] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11914.191301] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11914.224520] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11914.308597] Lustre: lustre-MDT0000: new disk, initializing [11914.423565] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11914.436786] Lustre: Skipped 1 previous similar message [11914.452433] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11919.155016] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11929.976908] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11930.090607] Lustre: 348576:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11930.136654] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11930.138566] Lustre: Skipped 1 previous similar message [11930.213523] Lustre: lustre-MDT0001: new disk, initializing [11930.392870] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11930.410843] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11933.940330] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11941.787151] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11948.753379] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11959.068576] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11959.543719] Lustre: lustre-OST0000: new disk, initializing [11959.556646] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11959.572705] Lustre: 350545:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11960.713314] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11960.722428] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11960.900095] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11967.265070] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [11976.297470] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11981.575834] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11981.753314] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11986.275049] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11986.482217] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11991.530073] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11991.532523] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11991.537097] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11991.542673] Lustre: Skipped 1 previous similar message [11991.571444] LustreError: Skipped 1 previous similar message [11994.331380] Lustre: server umount lustre-OST0000 complete [12001.766058] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12001.782398] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12001.786136] Lustre: Skipped 1 previous similar message [12001.815280] Lustre: Skipped 2 previous similar messages [12004.476912] Lustre: server umount lustre-MDT0000 complete [12006.885669] LustreError: 348584:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12006.917069] LustreError: 348584:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [12008.331947] LustreError: 348570:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788450871 with bad export cookie 4274759727971088832 [12008.336356] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12008.341654] LustreError: 348570:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [12008.757378] Lustre: server umount lustre-MDT0001 complete [12017.290663] XFS (loop0): Unmounting Filesystem [12022.009945] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 11:54:42 (1788450882) [12028.246451] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12028.717806] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12028.724182] Lustre: Skipped 2 previous similar messages [12033.163346] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12042.772605] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12047.437528] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12054.894701] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12061.280277] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12068.689988] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12075.351850] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12082.325304] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12098.027344] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12098.036057] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [12098.036081] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12098.039385] Lustre: Skipped 1 previous similar message [12100.515800] Lustre: server umount lustre-OST0000 complete [12111.308964] Lustre: server umount lustre-MDT0000 complete [12113.377717] LustreError: 353104:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12113.405679] LustreError: 353104:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [12115.552537] LustreError: 353085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788450978 with bad export cookie 4274759727971089721 [12115.569426] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12115.576493] LustreError: 353085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [12116.069633] Lustre: server umount lustre-MDT0001 complete [12128.411546] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [12131.709622] Key type lgssc unregistered [12132.007740] LNet: 356733:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12132.032047] LNetError: 356733:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [12132.051917] LNet: Removed LNI 192.168.202.126@tcp [12132.960379] Key type .llcrypt unregistered [12132.963283] Key type ._llcrypt unregistered [12168.927147] Key type ._llcrypt registered [12168.937914] Key type .llcrypt registered [12169.077447] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [12171.122955] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12171.157518] alg: No test for adler32 (adler32-zlib) [12172.402741] Lustre: Lustre: Build Version: 2.17.58_2_gee80f9b [12172.908944] LNet: Added LNI 192.168.202.126@tcp [8/256/0/180] [12174.688218] Key type lgssc registered [12175.887826] Lustre: Echo OBD driver; http://www.lustre.org/ [12183.027552] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [12183.045648] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12184.514194] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12190.823263] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12194.792890] LustreError: 358299:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12194.808151] LustreError: 358299:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [12199.924640] LustreError: 358300:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12201.729431] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12202.613596] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12209.059388] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12217.445536] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12223.565490] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12231.194759] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12231.727939] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12238.221779] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12245.746457] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12264.417893] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12264.425834] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12264.443797] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12265.449619] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12265.453481] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12265.502518] Lustre: Skipped 1 previous similar message [12266.847048] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.26@tcp (stopping) [12268.612216] Lustre: server umount lustre-MDT0001 complete [12270.564086] LustreError: 358300:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12275.708344] LustreError: 359736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12275.739420] LustreError: 359736:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [12280.806991] LustreError: 358300:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12280.836492] LustreError: 358300:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [12280.883918] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12281.022947] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12281.032071] Lustre: Found index 1 for lustre-MDT0001, updating log [12281.087440] Lustre: 358289:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12281.437809] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12286.139936] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12286.465880] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12290.556981] LustreError: 361926:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12290.565908] LustreError: 361926:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12290.576844] LustreError: 358291:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12290.644838] LustreError: 361929:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.202.126@tcp: cfg command failed: rc = -17 [12290.650552] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [12290.650552] [12593.634054] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12593.646687] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12593.654970] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12593.678420] Lustre: Skipped 1 previous similar message [12593.699545] Lustre: Skipped 1 previous similar message [12598.254279] Lustre: server umount lustre-MDT0001 complete [12598.755716] LustreError: 359736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12598.777311] LustreError: 359736:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [12611.225190] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12611.354117] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12611.361348] Lustre: Found index 1 for lustre-MDT0001, updating log [12611.409789] Lustre: 358288:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12611.691393] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12617.197832] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12617.768363] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12619.276240] LustreError: 370114:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12619.299794] LustreError: 370114:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12619.327713] LustreError: 358291:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12619.330876] LustreError: 358291:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12619.438305] LustreError: 370122:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [12619.457376] LustreError: 370122:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [12619.479275] LustreError: 370122:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.202.126@tcp: cfg command failed: rc = -17 [12619.505814] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.126@tcp [12619.505814] [12929.506360] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12929.519874] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12929.532691] Lustre: Skipped 1 previous similar message [12929.548072] Lustre: Skipped 2 previous similar messages [12931.918606] Lustre: server umount lustre-MDT0001 complete [12934.625746] LustreError: 358300:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12934.647315] LustreError: 358300:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 8 previous similar messages [12944.355607] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12944.447261] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12944.456602] Lustre: Found index 1 for lustre-MDT0001, updating log [12944.546435] Lustre: 358289:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12944.927035] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12949.857598] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [12950.015508] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12954.623346] LustreError: 378534:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12954.634100] LustreError: 378534:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12954.647880] LustreError: 358291:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12954.651676] LustreError: 358291:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12954.731710] LustreError: 378537:0:(lod_lov.c:208:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12954.742975] LustreError: 378537:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.202.126@tcp: cfg command failed: rc = -114 [12954.750872] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12954.750872] [13272.546769] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13272.550256] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [13272.587976] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13272.607093] Lustre: Skipped 3 previous similar messages [13284.320495] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [13284.492267] Lustre: server umount lustre-MDT0000 complete [13287.620936] LustreError: 358280:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788452150 with bad export cookie 1120904969870915440 [13287.626086] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13287.626298] LustreError: 358280:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [13287.906438] LustreError: 358296:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13287.908542] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13287.912075] LustreError: 358296:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [13287.919938] Lustre: Skipped 2 previous similar messages [13293.029246] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [13293.038171] Lustre: Skipped 7 previous similar messages [13294.120492] Lustre: server umount lustre-MDT0001 complete [13298.844332] Lustre: server umount lustre-OST0000 complete [13311.689726] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [13323.783590] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [13359.422546] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 12:17:00 (1788452220) [13365.554314] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13365.773255] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [13365.794493] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [13365.848511] Lustre: lustre-MDT0000: new disk, initializing [13365.901381] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [13365.917790] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [13370.536369] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [13381.075354] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13381.215311] Lustre: 389179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [13381.284145] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [13381.288323] Lustre: Skipped 1 previous similar message [13381.369612] Lustre: lustre-MDT0001: new disk, initializing [13381.480979] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [13381.538994] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [13381.549086] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [13386.779436] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [13395.820381] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [13401.302340] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [13407.936751] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [13408.182679] Lustre: lustre-OST0000: new disk, initializing [13408.185447] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [13408.190817] Lustre: 391149:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [13408.287464] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [13415.169842] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug -1 all [13416.516449] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [13416.533612] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [13416.672417] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [13425.443435] Lustre: DEBUG MARKER: oleg226-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [13434.223702] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [13434.230222] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13434.239926] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13440.639645] Lustre: server umount lustre-MDT0000 complete [13442.532497] LustreError: 389188:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13442.558961] LustreError: 389188:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [13444.475041] LustreError: 389172:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788452307 with bad export cookie 1120904969870917386 [13444.489035] LustreError: 389172:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [13444.494178] LustreError: MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13444.813303] Lustre: server umount lustre-MDT0001 complete [13458.432571] Lustre: server umount lustre-OST0000 complete [13487.110630] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing set_hostid [13496.444292] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local [13524.989676] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 13176 sec ========= 12:19:46 (1788452386) [13526.578241] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 12:19:47 (1788452387) === [13529.775394] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 12:19:50 (1788452390) === [13572.115969] Lustre: DEBUG MARKER: oleg226-server.virtnet: executing unload_modules_local [13574.788402] Key type lgssc unregistered [13575.065300] LNet: 397511:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13575.087022] LNetError: 397511:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [13575.103455] LNet: Removed LNI 192.168.202.126@tcp [13575.938584] Key type .llcrypt unregistered [13575.940985] Key type ._llcrypt unregistered