[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 508296459 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2448MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002406] x2apic enabled [ 0.003010] Switched APIC routing to physical x2apic. [ 0.004018] kvm-guest: setup PV IPIs [ 0.006732] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007020] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008013] pid_max: default: 32768 minimum: 301 [ 0.009146] LSM: Security Framework initializing [ 0.010061] Yama: becoming mindful. [ 0.011048] SELinux: Initializing. [ 0.012091] *** VALIDATE selinux *** [ 0.020479] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025442] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026145] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027125] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028122] *** VALIDATE tmpfs *** [ 0.029492] *** VALIDATE proc *** [ 0.030283] *** VALIDATE cgroup *** [ 0.031012] *** VALIDATE cgroup2 *** [ 0.032260] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.033168] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.034011] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.035031] Spectre V2 : User space: Vulnerable [ 0.036011] Speculative Store Bypass: Vulnerable [ 0.038936] debug: unmapping init [mem 0xffffffffb5659000-0xffffffffb5660fff] [ 0.041197] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.042797] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.043025] ... version: 2 [ 0.044018] ... bit width: 48 [ 0.045016] ... generic registers: 4 [ 0.046016] ... value mask: 0000ffffffffffff [ 0.047021] ... max period: 00007fffffffffff [ 0.048018] ... fixed-purpose events: 3 [ 0.049014] ... event mask: 000000070000000f [ 0.050295] rcu: Hierarchical SRCU implementation. [ 0.052412] smp: Bringing up secondary CPUs ... [ 0.053607] x86: Booting SMP configuration: [ 0.054029] .... node #0, CPUs: #1 #2 #3 [ 0.059121] smp: Brought up 1 node, 4 CPUs [ 0.061037] smpboot: Max logical packages: 1 [ 0.062017] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.142542] node 0 deferred pages initialised in 78ms [ 0.145132] devtmpfs: initialized [ 0.146255] x86/mm: Memory block size: 128MB [ 0.148693] gcov: version magic: 0x41383552 [ 0.149548] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.153151] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.156527] pinctrl core: initialized pinctrl subsystem [ 0.159354] [ 0.159975] ************************************************************* [ 0.162019] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.165022] ** ** [ 0.168022] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.170018] ** ** [ 0.173026] ** This means that this kernel is built to expose internal ** [ 0.175019] ** IOMMU data structures, which may compromise security on ** [ 0.177022] ** your system. ** [ 0.179018] ** ** [ 0.181023] ** If you see this message and you are not debugging the ** [ 0.184039] ** kernel, report this immediately to your vendor! ** [ 0.187019] ** ** [ 0.189024] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.192027] ************************************************************* [ 0.195780] NET: Registered protocol family 16 [ 0.197512] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.201063] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.204093] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.208140] cpuidle: using governor menu [ 0.209915] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.212528] PCI: Using configuration type 1 for base access [ 0.215141] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.225077] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.227039] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.231101] cryptd: max_cpu_qlen set to 1000 [ 0.235365] ACPI: Added _OSI(Module Device) [ 0.237016] ACPI: Added _OSI(Processor Device) [ 0.239024] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.241015] ACPI: Added _OSI(Processor Aggregator Device) [ 0.245222] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.252502] ACPI: Interpreter enabled [ 0.254089] ACPI: PM: (supports S0 S3 S4 S5) [ 0.256018] ACPI: Using IOAPIC for interrupt routing [ 0.258199] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.262441] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.272561] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.275043] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.278022] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.284081] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.289508] acpiphp: Slot [2] registered [ 0.291190] acpiphp: Slot [5] registered [ 0.292167] acpiphp: Slot [6] registered [ 0.294189] acpiphp: Slot [7] registered [ 0.296188] acpiphp: Slot [8] registered [ 0.298105] acpiphp: Slot [9] registered [ 0.299258] acpiphp: Slot [10] registered [ 0.301216] acpiphp: Slot [3] registered [ 0.303147] acpiphp: Slot [4] registered [ 0.304133] acpiphp: Slot [11] registered [ 0.306111] acpiphp: Slot [12] registered [ 0.308151] acpiphp: Slot [13] registered [ 0.309125] acpiphp: Slot [14] registered [ 0.311167] acpiphp: Slot [15] registered [ 0.313119] acpiphp: Slot [16] registered [ 0.314119] acpiphp: Slot [17] registered [ 0.316121] acpiphp: Slot [18] registered [ 0.318111] acpiphp: Slot [19] registered [ 0.319111] acpiphp: Slot [20] registered [ 0.321120] acpiphp: Slot [21] registered [ 0.323150] acpiphp: Slot [22] registered [ 0.324161] acpiphp: Slot [23] registered [ 0.326109] acpiphp: Slot [24] registered [ 0.328084] acpiphp: Slot [25] registered [ 0.330132] acpiphp: Slot [26] registered [ 0.331126] acpiphp: Slot [27] registered [ 0.333147] acpiphp: Slot [28] registered [ 0.335187] acpiphp: Slot [29] registered [ 0.337128] acpiphp: Slot [30] registered [ 0.338118] acpiphp: Slot [31] registered [ 0.340195] PCI host bridge to bus 0000:00 [ 0.342027] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.345035] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.347023] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.350031] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.353044] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.356042] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.358177] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.362099] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.365404] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.375754] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.381062] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.384024] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.386019] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.389020] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.394720] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.397819] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.400044] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.402804] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.407021] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.421015] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.429013] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.435644] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.445015] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.453016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.474024] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.485630] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.492020] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.498031] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.514023] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.524309] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.528025] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.534023] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.546035] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.557032] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.566028] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.575023] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.593026] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.606697] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.619021] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.631021] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.646025] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.663034] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.671034] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.678024] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.692029] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.703191] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.706160] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.708434] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.712512] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.715287] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.720211] iommu: Default domain type: Passthrough [ 0.722638] SCSI subsystem initialized [ 0.724244] ACPI: bus type USB registered [ 0.725174] usbcore: registered new interface driver usbfs [ 0.727139] usbcore: registered new interface driver hub [ 0.729188] usbcore: registered new device driver usb [ 0.731236] pps_core: LinuxPPS API ver. 1 registered [ 0.733019] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.738087] PTP clock support registered [ 0.741083] EDAC MC: Ver: 3.0.0 [ 0.743299] PCI: Using ACPI for IRQ routing [ 0.745991] NetLabel: Initializing [ 0.748015] NetLabel: domain hash size = 128 [ 0.749012] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.751096] NetLabel: unlabeled traffic allowed by default [ 0.753191] vgaarb: loaded [ 0.755296] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.757016] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.762467] clocksource: Switched to clocksource kvm-clock [ 0.882650] VFS: Disk quotas dquot_6.6.0 [ 0.884583] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.887038] *** VALIDATE ramfs *** [ 0.888422] *** VALIDATE hugetlbfs *** [ 0.890051] pnp: PnP ACPI init [ 0.893310] pnp: PnP ACPI: found 6 devices [ 0.915539] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.919063] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.921597] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.924243] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.927074] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.929966] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.933195] NET: Registered protocol family 2 [ 0.935866] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.942474] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.946567] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.952079] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.955710] TCP: Hash tables configured (established 65536 bind 65536) [ 0.958659] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.961868] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.964782] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.968025] NET: Registered protocol family 1 [ 0.971070] RPC: Registered named UNIX socket transport module. [ 0.973249] RPC: Registered udp transport module. [ 0.975460] RPC: Registered tcp transport module. [ 0.977600] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.980391] NET: Registered protocol family 44 [ 0.982542] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.985362] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.987484] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.989527] PCI: CLS 0 bytes, default 64 [ 0.991192] Unpacking initramfs... [ 2.479743] debug: unmapping init [mem 0xffff8bfc3cc54000-0xffff8bfc3ffbffff] [ 2.483905] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.486033] software IO TLB: mapped [mem 0x00000000b8c54000-0x00000000bcc54000] (64MB) [ 2.488836] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.009063] Initialise system trusted keyrings [ 3.010996] Key type blacklist registered [ 3.013207] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.022327] zbud: loaded [ 3.025472] *** VALIDATE nfs *** [ 3.026869] *** VALIDATE nfs4 *** [ 3.028888] pstore: using deflate compression [ 3.032753] Platform Keyring initialized [ 3.140770] NET: Registered protocol family 38 [ 3.143930] Key type asymmetric registered [ 3.145601] Asymmetric key parser 'x509' registered [ 3.147656] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.150286] io scheduler mq-deadline registered [ 3.151455] io scheduler kyber registered [ 3.152801] io scheduler bfq registered [ 3.154371] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.157449] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.160529] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.164727] ACPI: Power Button [PWRF] [ 3.171924] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.180351] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.201791] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.210901] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.233572] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.266212] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.300813] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.305893] Non-volatile memory driver v1.3 [ 3.307784] Linux agpgart interface v0.103 [ 3.368482] virtio_blk virtio1: [vda] 145176 512-byte logical blocks (74.3 MB/70.9 MiB) [ 3.374769] vda: detected capacity change from 0 to 74330112 [ 3.396517] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.399942] vdb: detected capacity change from 0 to 1073741824 [ 3.415943] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.419449] vdc: detected capacity change from 0 to 2621440000 [ 3.437637] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.440627] vdd: detected capacity change from 0 to 2621440000 [ 3.455511] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.458419] vde: detected capacity change from 0 to 4294967296 [ 3.473467] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.476839] vdf: detected capacity change from 0 to 4294967296 [ 3.484907] libphy: Fixed MDIO Bus: probed [ 3.491579] usbcore: registered new interface driver usbserial_generic [ 3.493929] usbserial: USB Serial support registered for generic [ 3.496691] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.501596] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.503666] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.506530] mousedev: PS/2 mouse device common for all mice [ 3.509870] rtc_cmos 00:05: RTC can wake from S4 [ 3.512375] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.514039] rtc_cmos 00:05: registered as rtc0 [ 3.518212] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.521359] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.522637] intel_pstate: CPU model not supported [ 3.528199] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.531245] hid: raw HID events driver (C) Jiri Kosina [ 3.533979] usbcore: registered new interface driver usbhid [ 3.535869] usbhid: USB HID core driver [ 3.537309] drop_monitor: Initializing network drop monitor service [ 3.539603] Initializing XFRM netlink socket [ 3.541495] NET: Registered protocol family 10 [ 3.544905] Segment Routing with IPv6 [ 3.546530] NET: Registered protocol family 17 [ 3.548774] mpls_gso: MPLS GSO support [ 3.554907] RAS: Correctable Errors collector initialized. [ 3.557228] AVX version of gcm_enc/dec engaged. [ 3.559022] AES CTR mode by8 optimization enabled [ 3.644078] sched_clock: Marking stable (3644038612, 0)->(4639436779, -995398167) [ 3.648135] registered taskstats version 1 [ 3.650469] Loading compiled-in X.509 certificates [ 3.652896] zswap: loaded using pool lzo/zbud [ 3.677379] Key type big_key registered [ 3.690389] Key type encrypted registered [ 3.692270] ima: No TPM chip found, activating TPM-bypass! [ 3.694604] ima: Allocated hash algorithm: sha1 [ 3.696346] ima: No architecture policies found [ 3.698278] evm: Initialising EVM extended attributes: [ 3.700421] evm: security.selinux [ 3.701807] evm: security.ima [ 3.703062] evm: security.capability [ 3.703996] evm: HMAC attrs: 0x1 [ 3.706076] rtc_cmos 00:05: setting system clock to 2026-06-23 14:33:50 UTC (1782225230) [ 3.711828] debug: unmapping init [mem 0xffffffffb6603000-0xffffffffb67fffff] [ 3.715451] debug: unmapping init [mem 0xffffffffb5382000-0xffffffffb5658fff] [ 3.723180] Write protecting the kernel read-only data: 28672k [ 3.726522] debug: unmapping init [mem 0xffffffffb3a03000-0xffffffffb3bfffff] [ 3.729438] debug: unmapping init [mem 0xffffffffb4314000-0xffffffffb43fffff] [ 3.768091] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.778021] systemd[1]: Detected virtualization kvm. [ 3.780097] systemd[1]: Detected architecture x86-64. [ 3.782357] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.808506] systemd[1]: No hostname configured. [ 3.810639] systemd[1]: Set hostname to . [ 3.813114] random: systemd: uninitialized urandom read (16 bytes read) [ 3.815836] systemd[1]: Initializing machine ID from random generator. [ 3.872989] random: ln: uninitialized urandom read (6 bytes read) [ 3.970528] random: systemd: uninitialized urandom read (16 bytes read) [ 3.973748] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 3.981756] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 3.987922] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ OK ] Started Memstrack Anylazing Service. Starting Setup Virtual Console... [ OK ] Reached target Swap. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Timers. [ OK ] Reached target Slices. [ OK ] Reached target Paths. Starting Create list of required st…ce nodes for the current kernel... Starting Journal Service... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.661507] device-mapper: uevent: version 1.0.3 [ 4.663970] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] [ 5.032904] random: fast init done Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.456370] scsi host0: ata_piix [ 5.464375] virtio_net virtio0 ens2: renamed from eth0 [ 5.477051] scsi host1: ata_piix [ 5.479061] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.482167] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.095210] dracut-initqueue[579]: RTNETLINK answers: File exists [ 10.212345] random: crng init done [ 10.213836] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.692415] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.969148] printk: systemd: 25 output lines suppressed due to ratelimiting [ 12.251121] SELinux: Disabled at runtime. [ 12.318076] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.326330] systemd[1]: Detected virtualization kvm. [ 12.328381] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.888719] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.892687] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.897778] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.902091] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.906240] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.916094] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.922439] systemd[1]: Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Stopped target Switch Root. [ OK ] Listening on udev Control Socket. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on Process Core Dump Socket. Mounting POSIX Message Queue File System... [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Huge Pages File System... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on RPCbind Server Activation Socket. Activating swap /dev/disk/by-label/SWAP... Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-getty.slice. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Forward Password Requests to Wall Directory Watch. Starting Apply Kernel Variables... [ 13.072674] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target RPC Port Mapper. [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 13.446483] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 13.783609] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.830295] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.986463] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 14.003475] EDAC sbridge: Ver: 1.1.2 [ 15.637862] Key type dns_resolver registered [ 15.965573] NFS: Registering the id_resolver key type [ 15.968791] Key type id_resolver registered [ 15.970678] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started RPC Bind. [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Restore /run/initramfs on shutdown... Starting Login Service... [ OK ] Started irqbalance daemon. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg302-server login: [ 42.640468] libcfs: loading out-of-tree module taints kernel. [ 42.665942] Key type ._llcrypt registered [ 42.667621] Key type .llcrypt registered [ 42.721049] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 52.030691] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 52.857856] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 52.867171] alg: No test for adler32 (adler32-zlib) [ 53.912636] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 54.296515] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 55.935595] Key type lgssc registered [ 56.656209] Lustre: Echo OBD driver; http://www.lustre.org/ [ 77.928128] hrtimer: interrupt took 6342085 ns [ 78.754199] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 124.534720] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 138.962329] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 139.013924] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 140.377325] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 140.415662] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 140.553744] Lustre: lustre-MDT0000: new disk, initializing [ 140.690204] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 140.731593] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 145.477454] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 159.857337] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 159.982956] Lustre: 6482:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 160.042525] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 160.048960] Lustre: Skipped 1 previous similar message [ 160.163493] Lustre: lustre-MDT0001: new disk, initializing [ 160.234383] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 160.287377] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 160.294892] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 165.129353] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 170.777325] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 181.357970] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 181.770199] Lustre: lustre-OST0000: new disk, initializing [ 181.788489] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 181.798621] Lustre: 8420:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 181.874556] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 182.126037] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 182.137552] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 182.273926] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 187.993929] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 202.526985] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 202.745577] Lustre: lustre-OST0001: new disk, initializing [ 202.752901] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 202.759952] Lustre: 9491:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 202.850073] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 210.506893] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 210.520116] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 210.601183] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 210.824738] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 224.927536] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 232.533408] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 239.345736] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing check_logdir /tmp/testlogs/ [ 244.421794] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing yml_node [ 249.108820] Lustre: DEBUG MARKER: Client: 2.17.54.83 [ 251.944250] Lustre: DEBUG MARKER: MDS: 2.17.54.83 [ 254.444366] Lustre: DEBUG MARKER: OSS: 2.17.54.83 [ 256.064535] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Jun 23 10:38:00 EDT 2026 [ 272.777268] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 274.276272] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 292.320946] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 292.339537] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 292.340275] Lustre: Skipped 1 previous similar message [ 292.367401] Lustre: Skipped 3 previous similar messages [ 295.957377] Lustre: server umount lustre-MDT0000 complete [ 300.401837] LustreError: 6474:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225527 with bad export cookie 15790361771210681568 [ 300.419571] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 300.421208] LustreError: 6474:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 302.560834] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 302.567119] LustreError: 12025:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 302.567305] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 302.575193] Lustre: Skipped 3 previous similar messages [ 302.606397] LustreError: 12025:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 305.568976] LustreError: 7908:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 305.570424] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 305.598832] LustreError: 7908:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 305.628074] Lustre: Skipped 2 previous similar messages [ 306.822760] Lustre: server umount lustre-MDT0001 complete [ 310.899176] Lustre: server umount lustre-OST0000 complete [ 315.475726] Lustre: server umount lustre-OST0001 complete [ 322.897387] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 333.275649] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 367.540676] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 367.749645] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 367.775332] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 367.858727] Lustre: lustre-MDT0000: new disk, initializing [ 367.951683] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 367.977325] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 371.667790] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 381.602985] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 381.795452] Lustre: 15047:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 381.911113] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 381.924521] Lustre: Skipped 1 previous similar message [ 382.059886] Lustre: lustre-MDT0001: new disk, initializing [ 382.227284] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 382.308261] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 382.325508] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 387.105589] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 396.357783] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 401.106980] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 407.030744] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 407.284878] Lustre: lustre-OST0000: new disk, initializing [ 407.290884] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 407.296543] Lustre: 17014:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 407.367739] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 409.046532] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 409.058298] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 409.162290] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 413.017733] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 422.147982] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 426.722799] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 426.905926] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 431.467904] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 431.786374] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 434.665860] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 434.673811] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 434.693586] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 434.705907] Lustre: Skipped 1 previous similar message [ 439.778251] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 439.784202] Lustre: Skipped 2 previous similar messages [ 440.571750] Lustre: server umount lustre-OST0000 complete [ 444.898170] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 444.923714] Lustre: Skipped 1 previous similar message [ 450.016916] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 450.026727] Lustre: Skipped 3 previous similar messages [ 450.941935] Lustre: server umount lustre-MDT0000 complete [ 454.880561] LustreError: 15039:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225681 with bad export cookie 15790361771210683101 [ 454.889258] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 454.895655] LustreError: 15039:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 455.368127] Lustre: server umount lustre-MDT0001 complete [ 460.588504] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 10:41:24 (1782225684) [ 467.834822] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 468.331747] LustreError: 19280:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 468.397279] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 472.819080] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 473.577353] LustreError: 19281:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 478.691076] LustreError: 19280:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 481.531293] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 486.142896] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 494.128399] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 499.968608] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 506.030049] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 511.911677] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 519.381921] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 522.697387] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 527.843852] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 527.854520] LustreError: Skipped 1 previous similar message [ 527.858142] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 527.875961] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 533.549665] Lustre: server umount lustre-MDT0000 complete [ 533.986939] LustreError: 19277:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 534.005775] LustreError: 19277:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 536.287138] LustreError: 19261:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225763 with bad export cookie 15790361771210683983 [ 536.296978] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 536.573295] Lustre: server umount lustre-MDT0001 complete [ 550.049494] Lustre: server umount lustre-OST0000 complete [ 568.974574] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 577.779112] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 578.159342] LustreError: 23661:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 578.196058] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 578.205838] Lustre: Skipped 2 previous similar messages [ 581.731315] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 588.921782] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 592.947646] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 595.365128] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 601.400598] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 608.293359] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 616.341657] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 616.537964] Lustre: lustre-OST0001: new disk, initializing [ 616.541282] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 616.546316] Lustre: 25974:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 618.268212] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 618.288196] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 618.401590] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 622.416179] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 631.543162] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 635.690277] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 649.189962] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 649.203446] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 649.219864] Lustre: Skipped 4 previous similar messages [ 649.244328] Lustre: Skipped 6 previous similar messages [ 655.026568] Lustre: server umount lustre-MDT0000 complete [ 658.506342] LustreError: 23642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225885 with bad export cookie 15790361771210684830 [ 658.510517] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 658.518568] LustreError: 23642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 658.860118] Lustre: server umount lustre-MDT0001 complete [ 671.468677] Lustre: server umount lustre-OST0000 complete [ 685.173628] Lustre: server umount lustre-OST0001 complete [ 700.275811] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 709.457323] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 709.830202] LustreError: 28996:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 709.843447] LustreError: 28996:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 709.905018] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 709.908276] Lustre: Skipped 3 previous similar messages [ 713.912847] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 721.749357] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 726.387953] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 729.039969] Lustre: 30144:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 734.786996] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 740.827900] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 749.867246] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 755.803388] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 762.933223] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 765.999470] Lustre: 32023:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 773.097136] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 773.112233] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 773.133360] Lustre: Skipped 1 previous similar message [ 773.138621] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 773.149197] Lustre: Skipped 4 previous similar messages [ 777.675558] Lustre: server umount lustre-MDT0000 complete [ 779.749438] LustreError: 29732:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 779.771470] LustreError: 29732:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 780.704843] LustreError: 28978:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226007 with bad export cookie 15790361771210686125 [ 780.707025] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 780.713969] LustreError: 28978:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 780.988615] Lustre: server umount lustre-MDT0001 complete [ 795.295185] Lustre: server umount lustre-OST0000 complete [ 809.353716] Lustre: server umount lustre-OST0001 complete [ 817.662342] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 10:47:21 (1782226041) [ 846.032166] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 855.982492] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 861.710369] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 871.466968] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 877.003937] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 879.972530] Lustre: 35973:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 886.606989] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 893.395901] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 902.724584] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 909.199914] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 915.770767] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 919.151628] Lustre: 37853:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 923.620466] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 923.625169] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 923.634165] Lustre: Skipped 5 previous similar messages [ 923.638845] Lustre: Skipped 5 previous similar messages [ 928.231249] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 929.660781] Lustre: server umount lustre-MDT0000 complete [ 932.724473] LustreError: 34806:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226159 with bad export cookie 15790361771210687231 [ 932.734804] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 932.746691] LustreError: 34806:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 933.100112] Lustre: server umount lustre-MDT0001 complete [ 946.797232] Lustre: server umount lustre-OST0000 complete [ 949.727225] Lustre: 3613:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782226160/real 1782226160] req@ffff8bfcc062a680 x1868798656585472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782226176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 950.155767] Lustre: server umount lustre-OST0001 complete [ 957.490748] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 10:49:42 (1782226182) [ 972.839188] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 981.518781] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 981.914146] LustreError: 39992:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 981.932331] LustreError: 39992:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 981.997116] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 982.000499] Lustre: Skipped 7 previous similar messages [ 986.108800] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 993.276411] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 997.335216] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 999.518596] Lustre: 41143:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1004.844885] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1010.656818] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1018.134573] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1023.743730] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1030.440372] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1033.762622] Lustre: 43019:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1034.637164] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1034.642342] Lustre: Skipped 1 previous similar message [ 1039.851835] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1039.856038] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1039.865418] Lustre: Skipped 3 previous similar messages [ 1043.468428] Lustre: server umount lustre-MDT0000 complete [ 1047.042341] LustreError: 40024:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226273 with bad export cookie 15790361771210688337 [ 1047.057056] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1047.061214] LustreError: 40024:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1053.566868] Lustre: server umount lustre-MDT0001 complete [ 1062.204605] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1076.185451] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1082.348934] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1084.216770] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1089.178768] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1090.040464] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1090.055062] Lustre: Skipped 1 previous similar message [ 1096.737863] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1098.449639] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1103.526957] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1105.182829] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1109.990583] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1115.816217] Lustre: server umount lustre-MDT0000 complete [ 1119.320435] LustreError: 39973:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226346 with bad export cookie 15790361771210689464 [ 1119.323384] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1119.329656] LustreError: 39973:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1119.618693] Lustre: server umount lustre-MDT0001 complete [ 1133.864639] Lustre: server umount lustre-OST0000 complete [ 1137.119122] Lustre: 3616:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782226347/real 1782226347] req@ffff8bfca0ca0a80 x1868798656668544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782226363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1137.445737] Lustre: server umount lustre-OST0001 complete [ 1147.263926] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 10:52:51 (1782226371) [ 1162.686639] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1171.843244] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1176.326975] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1184.306784] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1189.302630] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1192.228332] Lustre: 48774:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1198.118117] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1204.699274] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1213.672354] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1219.735506] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1227.866347] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1232.436192] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1244.938206] Lustre: server umount lustre-MDT0000 complete [ 1246.178095] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1246.185972] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1246.199289] Lustre: Skipped 9 previous similar messages [ 1246.212647] LustreError: 48360:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1246.232682] LustreError: 48360:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 29 previous similar messages [ 1248.424258] LustreError: 47604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226475 with bad export cookie 15790361771210690262 [ 1248.427081] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1248.442493] LustreError: 47604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1248.788553] Lustre: server umount lustre-MDT0001 complete [ 1263.209697] Lustre: server umount lustre-OST0000 complete [ 1276.530568] Lustre: server umount lustre-OST0001 complete [ 1285.484732] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 10:55:09 (1782226509) [ 1287.938751] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1289.708624] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 10:55:13 (1782226513) [ 1301.280193] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 1310.557559] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1333.081572] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1333.335809] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1333.416780] Lustre: lustre-MDT0000: new disk, initializing [ 1333.604598] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1338.337318] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1347.575833] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1354.701343] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1355.017289] Lustre: lustre-OST0000: new disk, initializing [ 1355.020796] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1355.025880] Lustre: Skipped 1 previous similar message [ 1355.029958] Lustre: 54849:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1356.965647] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1356.978049] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1357.017248] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1361.403950] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1370.633875] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1372.944075] Lustre: DEBUG MARKER: create test files [ 1403.363568] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1403.379599] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1403.388127] Lustre: Skipped 24 previous similar messages [ 1409.635768] Lustre: server umount lustre-OST0000 complete [ 1413.983387] Lustre: server umount lustre-MDT0000 complete [ 1425.725564] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 1428.731290] Key type lgssc unregistered [ 1429.037598] LNet: 56478:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1429.047643] LNetError: 56478:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1429.067589] LNet: Removed LNI 192.168.203.102@tcp [ 1429.955158] Key type .llcrypt unregistered [ 1429.958595] Key type ._llcrypt unregistered [ 1459.565211] Key type ._llcrypt registered [ 1459.575653] Key type .llcrypt registered [ 1459.702376] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1461.278266] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1461.300626] alg: No test for adler32 (adler32-zlib) [ 1462.301418] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 1462.586896] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 1464.359157] Key type lgssc registered [ 1465.523536] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1474.340823] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1474.369104] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1475.793856] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1481.820764] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1491.519548] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1498.877300] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1499.210245] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1500.296024] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:98 to 0x240000400:129) [ 1500.383578] Lustre: 59218:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1500.405295] Lustre: 59218:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1500.417168] Lustre: 59218:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1500.425720] Lustre: 59218:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1500.441760] Lustre: 59218:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1500.465468] Lustre: 59218:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1505.126743] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1512.359829] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1518.450929] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1523.624427] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1531.364545] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1531.415767] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1531.855574] Lustre: server umount lustre-OST0000 complete [ 1536.411681] Lustre: server umount lustre-MDT0000 complete [ 1547.952179] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 1552.275290] Key type lgssc unregistered [ 1552.660751] LNet: 60824:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1552.671678] LNetError: 60824:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1553.702945] LNet: Removed LNI 192.168.203.102@tcp [ 1555.049955] Key type .llcrypt unregistered [ 1555.054809] Key type ._llcrypt unregistered [ 1587.275122] Key type ._llcrypt registered [ 1587.277164] Key type .llcrypt registered [ 1587.367691] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1588.368327] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1588.557600] alg: No test for adler32 (adler32-zlib) [ 1589.630434] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 1589.962093] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 1591.687215] Key type lgssc registered [ 1592.867588] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1601.190089] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1601.239706] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1602.620366] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1606.999380] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1613.971070] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1620.419873] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1620.764277] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1627.063974] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1627.954772] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1628.044138] Lustre: 63660:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1628.053810] Lustre: 63660:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1628.063393] Lustre: 63660:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1628.073158] Lustre: 63660:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1628.078821] Lustre: 63660:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1628.088627] Lustre: 63660:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1634.163985] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1639.591111] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1648.608779] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1648.617102] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1648.632736] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1653.729716] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1654.345864] Lustre: server umount lustre-OST0000 complete [ 1659.136625] Lustre: server umount lustre-MDT0000 complete [ 1669.241443] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 1672.204568] Key type lgssc unregistered [ 1672.505261] LNet: 65236:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1672.517675] LNetError: 65236:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1672.541365] LNet: Removed LNI 192.168.203.102@tcp [ 1673.326424] Key type .llcrypt unregistered [ 1673.328581] Key type ._llcrypt unregistered [ 1690.923161] Key type ._llcrypt registered [ 1690.926495] Key type .llcrypt registered [ 1691.073811] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 1706.838077] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1707.898398] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1708.057815] alg: No test for adler32 (adler32-zlib) [ 1709.176846] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 1709.442592] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 1711.127167] Key type lgssc registered [ 1712.243332] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1746.551425] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1746.593433] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1747.973758] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1748.027519] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1748.106617] Lustre: lustre-MDT0000: new disk, initializing [ 1748.171096] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1748.194575] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1752.840280] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1763.975779] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1764.115205] Lustre: 68389:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1764.302591] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1764.308533] Lustre: Skipped 1 previous similar message [ 1764.421432] Lustre: lustre-MDT0001: new disk, initializing [ 1764.495219] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1764.534111] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1764.554041] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1768.685213] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1778.112866] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1783.789330] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1790.654716] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1790.927147] Lustre: lustre-OST0000: new disk, initializing [ 1790.937982] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1790.955321] Lustre: 70356:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1791.064587] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1797.042230] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1800.275292] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1800.296341] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1800.468142] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1806.354928] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1810.718732] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1810.882903] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1814.976364] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1815.165711] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1821.156332] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1821.156478] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1821.166959] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1821.170367] LustreError: Skipped 1 previous similar message [ 1821.180206] Lustre: Skipped 1 previous similar message [ 1826.280431] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1826.289253] Lustre: Skipped 1 previous similar message [ 1831.391130] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1831.401520] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1831.406508] Lustre: Skipped 1 previous similar message [ 1831.500757] Lustre: server umount lustre-OST0000 complete [ 1836.512127] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1836.514437] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1836.536340] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1836.564221] Lustre: Skipped 1 previous similar message [ 1840.683381] Lustre: server umount lustre-MDT0000 complete [ 1841.645708] LustreError: 68400:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1841.678877] LustreError: 68400:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1844.311485] LustreError: 68382:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227071 with bad export cookie 2904185846261969994 [ 1844.321384] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1844.331933] LustreError: 68382:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1844.654307] Lustre: server umount lustre-MDT0001 complete [ 1852.385640] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 11:04:36 (1782227076) [ 1863.954207] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1905.762121] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 1915.900936] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 1953.544874] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1953.858481] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1953.925482] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1954.052481] Lustre: lustre-MDT0000: new disk, initializing [ 1954.123237] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1954.139948] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1958.429820] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1971.051498] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1971.216603] Lustre: 76379:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1971.287610] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1971.309323] Lustre: Skipped 1 previous similar message [ 1971.392843] Lustre: lustre-MDT0001: new disk, initializing [ 1971.536533] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1971.587956] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1971.601968] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1976.195569] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 1986.724751] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1993.345923] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2001.395231] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2001.818204] Lustre: lustre-OST0000: new disk, initializing [ 2001.826655] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2001.843820] Lustre: 78348:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2001.962238] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2009.691326] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2009.706249] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2009.939403] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2010.362481] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2020.478234] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2025.575049] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2025.940517] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2030.491937] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2030.754515] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2035.691467] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2035.696262] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2035.703644] LustreError: Skipped 1 previous similar message [ 2035.715957] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2035.733026] Lustre: Skipped 2 previous similar messages [ 2039.131982] Lustre: server umount lustre-OST0000 complete [ 2043.360135] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2043.365825] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2043.378914] Lustre: Skipped 1 previous similar message [ 2045.923949] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2045.932032] Lustre: Skipped 2 previous similar messages [ 2048.737649] Lustre: server umount lustre-MDT0000 complete [ 2051.040748] LustreError: 76391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2051.053818] LustreError: 76391:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2052.330732] LustreError: 76371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227279 with bad export cookie 2904185846261970869 [ 2052.344227] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2052.348010] LustreError: 76371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2052.821160] Lustre: server umount lustre-MDT0001 complete [ 2060.777126] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 11:08:05 (1782227285) [ 2067.254680] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2067.809680] LustreError: 80760:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2067.866566] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2071.871529] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2073.057566] LustreError: 80761:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2078.181040] LustreError: 80760:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2079.452819] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2084.304781] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2091.278590] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2096.670414] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2104.564181] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2105.141924] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2105.183299] Lustre: Skipped 1 previous similar message [ 2112.087114] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2120.104547] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2123.388611] Lustre: 83439:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting da2ab262-af2f-40a2-b2fe-bc7e64176cbe at adminstrative request [ 2124.582838] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2124.607058] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2135.010115] Lustre: MGS: Client da2ab262-af2f-40a2-b2fe-bc7e64176cbe (at 0@lo) reconnecting [ 2135.025779] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x284dbda3e0297b2e to 0x284dbda3e0297dce [ 2135.038319] Lustre: MGC192.168.203.102@tcp: Connection restored to 0@lo (at 0@lo) [ 2160.451405] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2160.606865] Lustre: lustre-OST0001: new disk, initializing [ 2160.616169] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2160.624927] Lustre: 83831:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2166.952389] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2166.964537] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2167.064025] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2167.360105] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2176.686286] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2182.626581] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2182.630298] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2182.649802] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2182.657794] Lustre: Skipped 2 previous similar messages [ 2182.676663] Lustre: Skipped 1 previous similar message [ 2185.785346] Lustre: server umount lustre-OST0001 complete [ 2187.766712] LustreError: 82580:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2187.801676] LustreError: 82580:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2191.335344] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2191.352532] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2196.205055] Lustre: server umount lustre-OST0000 complete [ 2205.954762] Lustre: server umount lustre-MDT0000 complete [ 2208.228807] LustreError: 80760:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2208.251721] LustreError: 80760:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2209.471590] LustreError: 80740:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227436 with bad export cookie 2904185846261972430 [ 2209.476364] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2209.495496] LustreError: 80740:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2210.042860] Lustre: server umount lustre-MDT0001 complete [ 2218.493410] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 11:10:42 (1782227442) [ 2220.145477] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2221.705134] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 11:10:46 (1782227446) [ 2223.305527] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2225.173841] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 11:10:49 (1782227449) [ 2227.204750] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2229.329103] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 11:10:53 (1782227453) [ 2231.404721] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2233.572951] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 11:10:57 (1782227457) [ 2235.374969] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2241.935227] loop: module loaded [ 2241.968105] loop0: detected capacity change from 0 to 4294967296 [ 2242.033099] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2244.063284] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2247.737699] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2251.714182] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2276.915361] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2276.971934] LustreError: 87956:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2276.979516] LustreError: 87956:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2276.992579] LustreError: 87956:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2277.000457] LustreError: 87956:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2292.774251] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 2301.832071] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 2335.701622] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2335.951497] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2335.972987] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2336.058760] Lustre: lustre-MDT0000: new disk, initializing [ 2336.129347] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2336.134920] Lustre: Skipped 1 previous similar message [ 2336.150283] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2340.287955] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2349.950182] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2350.044958] Lustre: 90822:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2350.280343] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2354.478579] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2363.400771] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2368.666963] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2374.906556] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2375.163355] Lustre: 92788:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2382.108585] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2383.468597] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2383.621969] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2391.769472] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2396.457602] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2396.622862] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2400.548302] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2400.761974] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2404.331634] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2404.332767] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2404.340517] LustreError: Skipped 2 previous similar messages [ 2404.342319] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2404.342326] Lustre: Skipped 6 previous similar messages [ 2404.388299] Lustre: Skipped 4 previous similar messages [ 2408.663860] Lustre: server umount lustre-OST0000 complete [ 2418.435753] Lustre: server umount lustre-MDT0000 complete [ 2419.685935] LustreError: 90832:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2419.716104] LustreError: 90832:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2422.484715] LustreError: 90813:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227649 with bad export cookie 2904185846261973046 [ 2422.489226] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2422.506455] LustreError: 90813:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2423.019828] Lustre: server umount lustre-MDT0001 complete [ 2431.516944] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 11:14:15 (1782227655) [ 2438.093911] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2442.811696] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2451.244572] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2455.365429] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2461.268456] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2466.539428] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2472.257210] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2472.660553] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2472.673973] Lustre: Skipped 4 previous similar messages [ 2478.485449] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2485.170925] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2489.306806] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2489.497864] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2493.564271] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2493.831948] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2499.715069] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2499.945569] Lustre: lustre-OST0001: new disk, initializing [ 2499.951841] Lustre: Skipped 2 previous similar messages [ 2499.954756] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2499.959595] Lustre: Skipped 3 previous similar messages [ 2499.969287] Lustre: 98572:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2506.034696] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2506.378935] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2506.388609] Lustre: Skipped 2 previous similar messages [ 2506.396560] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2506.465433] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2514.676734] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2519.028610] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2519.182980] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2523.542691] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2523.744438] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2541.611647] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2563.492730] Lustre: Failing over lustre-MDT0000 [ 2563.903862] Lustre: server umount lustre-MDT0000 complete [ 2564.576953] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2564.590097] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2564.606993] Lustre: Skipped 2 previous similar messages [ 2564.612616] LustreError: 95928:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2564.641885] LustreError: 95928:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2583.455573] Lustre: 66611:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782227794/real 1782227794] req@00000000d087047a x1868800391910784/t0(0) o400->MGC192.168.203.102@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1782227810 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2583.479363] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2585.920146] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2585.936682] LDISKFS-fs (dm-0): recovery complete [ 2585.950439] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2593.768943] LustreError: 66610:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@000000000cb990f1 x1868800391918464/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2594.081680] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2597.598731] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2598.670623] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2598.683384] Lustre: 95934:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2599.393916] Lustre: 96489:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2599.407178] Lustre: 96489:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 1 previous similar message [ 2599.427865] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 2599.475795] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2599.791116] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2600.124967] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2600.137308] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 2600.463759] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2600.470586] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 2600.485862] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2600.501494] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 7 previous similar messages [ 2601.157126] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2601.172311] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 2 previous similar messages [ 2601.495670] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2601.502478] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 2 previous similar messages [ 2602.791064] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2602.805434] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 6 previous similar messages [ 2603.445381] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2603.453167] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 2603.776266] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2603.794958] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 2607.025022] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2607.058072] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 12 previous similar messages [ 2607.721343] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2607.747818] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 2608.074748] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2608.091760] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 2615.128500] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2615.137057] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 24 previous similar messages [ 2615.838956] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2615.856651] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 24 previous similar messages [ 2616.175478] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2616.231214] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 24 previous similar messages [ 2631.438367] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2631.455254] Lustre: 101418:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 45 previous similar messages [ 2632.097546] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2632.119320] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 45 previous similar messages [ 2632.493094] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2632.502161] LustreError: 101418:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 45 previous similar messages [ 2658.215330] Lustre: 101418:0:(ldlm_lib.c:2380:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2658.229353] Lustre: 101418:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2658.242440] Lustre: 101418:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 02d6c518-e829-4ff6-bead-362556cd779d@192.168.203.2@tcp [ 2658.255601] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2658.268693] Lustre: 101418:0:(ldlm_lib.c:1900:abort_req_replay_queue()) @@@ aborted: req@000000006e91831d x1868800373885952/t0(8589934774) o35->02d6c518-e829-4ff6-bead-362556cd779d@192.168.203.2@tcp:565/0 lens 392/0 e 0 to 0 dl 1782227895 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2658.303758] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2658.322227] Lustre: lustre-MDT0000: Denying connection for new client 02d6c518-e829-4ff6-bead-362556cd779d (at 192.168.203.2@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2658.342208] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2658.395505] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2658.403571] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2658.412018] Lustre: Skipped 2 previous similar messages [ 2658.460477] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 2658.469303] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 2671.073563] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2671.076556] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2671.103051] Lustre: Skipped 4 previous similar messages [ 2671.124717] Lustre: Skipped 4 previous similar messages [ 2677.133073] Lustre: server umount lustre-OST0000 complete [ 2681.329128] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2686.796723] Lustre: server umount lustre-OST0001 complete [ 2696.673733] LustreError: 95200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2696.701118] LustreError: 95200:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 43 previous similar messages [ 2696.793132] Lustre: server umount lustre-MDT0000 complete [ 2700.743684] LustreError: 95180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227927 with bad export cookie 2904185846262024265 [ 2700.746072] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2700.759253] LustreError: 95180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2701.211687] Lustre: server umount lustre-MDT0001 complete [ 2712.048980] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 11:18:55 (1782227935) [ 2720.867582] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2720.877573] Lustre: *** cfs_fail_loc=197, val=0*** [ 2736.479949] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2741.601431] LustreError: 103395:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.102@tcp: failed processing log, type 4: rc = -110 [ 2746.827890] Lustre: *** cfs_fail_loc=197, val=0*** [ 2746.832290] Lustre: Skipped 65 previous similar messages [ 2767.392194] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2767.409134] Lustre: Skipped 2 previous similar messages [ 2776.025458] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2784.983773] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2787.990474] Lustre: server umount lustre-OST0000 complete [ 2797.191365] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 11:20:21 (1782228021) [ 2819.188250] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2824.221680] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2833.562970] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2837.246084] LustreError: 105048:0:(osp_object.c:629:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2837.258716] LustreError: 105048:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2837.264813] LustreError: 105048:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 18, retries 0, failed: rc = -5 [ 2837.880825] Lustre: server umount lustre-MDT0000 complete [ 2871.978434] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 2881.923921] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 2916.408195] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2916.693130] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2916.732069] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2916.850211] Lustre: lustre-MDT0000: new disk, initializing [ 2917.012396] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2921.222885] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2931.742390] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2931.871982] Lustre: 109223:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2932.167833] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2936.802591] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2945.660788] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2951.465667] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2958.661553] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2958.869584] Lustre: 111193:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2964.693354] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 2968.319334] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2974.263865] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2979.299668] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2979.563510] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2984.618852] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2984.819810] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2989.039840] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2989.048320] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2989.063050] Lustre: Skipped 4 previous similar messages [ 2989.068586] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2989.074973] Lustre: Skipped 9 previous similar messages [ 2993.011559] Lustre: server umount lustre-OST0000 complete [ 3003.108725] Lustre: server umount lustre-MDT0000 complete [ 3004.385194] LustreError: 109231:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3004.400565] LustreError: 109231:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 3007.260645] LustreError: 109215:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228234 with bad export cookie 2904185846262034898 [ 3007.268659] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3007.273687] LustreError: 109215:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3007.701259] Lustre: server umount lustre-MDT0001 complete [ 3018.763423] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 11:24:03 (1782228243) [ 3027.773552] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 3030.587401] Key type lgssc unregistered [ 3030.938585] LNet: 113681:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3030.945476] LNetError: 113681:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3031.978120] LNet: Removed LNI 192.168.203.102@tcp [ 3032.927745] Key type .llcrypt unregistered [ 3032.934472] Key type ._llcrypt unregistered [ 3050.093977] Key type ._llcrypt registered [ 3050.100573] Key type .llcrypt registered [ 3050.245167] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 3065.453285] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 3066.440996] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3066.582669] alg: No test for adler32 (adler32-zlib) [ 3067.532840] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 3067.800604] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 3069.471184] Key type lgssc registered [ 3070.696286] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3114.093336] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3114.139087] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3115.437236] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3115.458458] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3115.515364] Lustre: lustre-MDT0000: new disk, initializing [ 3115.600610] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3115.624563] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3120.806490] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3131.828593] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3132.228589] Lustre: lustre-OST0000: new disk, initializing [ 3132.242198] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3132.251090] Lustre: Skipped 1 previous similar message [ 3132.263114] Lustre: 117855:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3132.346695] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3137.980926] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3140.739381] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3140.754043] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3140.808283] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3147.637120] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3147.811282] Lustre: lustre-OST0001: new disk, initializing [ 3147.815911] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3147.822951] Lustre: 118719:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3147.909050] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3154.124751] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3155.581182] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3155.591918] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3155.621646] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3165.668457] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3165.681377] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3165.705678] Lustre: Skipped 1 previous similar message [ 3168.975858] Lustre: server umount lustre-MDT0000 complete [ 3175.658642] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3180.310635] LustreError: 117039:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228407 with bad export cookie 10940123372703085694 [ 3180.326137] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3180.576114] Lustre: server umount lustre-OST0000 complete [ 3184.533911] Lustre: server umount lustre-OST0001 complete [ 3193.180479] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 11:26:57 (1782228417) [ 3203.980434] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 3225.966616] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 11:27:30 (1782228450) [ 3264.828601] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 3275.188243] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 3311.908127] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3312.210141] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3312.265443] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3312.337429] Lustre: lustre-MDT0000: new disk, initializing [ 3312.475149] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3312.514117] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3317.696961] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3328.528983] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3328.676759] Lustre: 125471:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3328.770649] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3328.775793] Lustre: Skipped 1 previous similar message [ 3328.885677] Lustre: lustre-MDT0001: new disk, initializing [ 3328.959527] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3328.996278] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3329.014317] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3333.628759] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3342.144862] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3348.012689] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3354.803811] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3355.057218] Lustre: lustre-OST0000: new disk, initializing [ 3355.063660] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3355.071272] Lustre: 127446:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3355.183542] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3360.960871] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3363.932172] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3363.942696] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3364.136770] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3370.380376] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3375.298063] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3375.538288] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3380.430749] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3380.670936] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3384.808349] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3384.809067] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3384.814382] LustreError: Skipped 1 previous similar message [ 3384.817119] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3384.835217] Lustre: Skipped 1 previous similar message [ 3384.857872] Lustre: Skipped 2 previous similar messages [ 3389.928965] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3389.936031] Lustre: Skipped 1 previous similar message [ 3395.041907] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3395.056135] Lustre: Skipped 1 previous similar message [ 3397.087519] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3397.418278] Lustre: server umount lustre-OST0000 complete [ 3405.282454] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3405.291882] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3405.292738] Lustre: Skipped 1 previous similar message [ 3407.759778] Lustre: server umount lustre-MDT0000 complete [ 3411.311469] LustreError: 125464:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228638 with bad export cookie 10940123372703086919 [ 3411.317467] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3411.326418] LustreError: 125464:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 3411.893645] Lustre: server umount lustre-MDT0001 complete [ 3420.146888] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 11:30:44 (1782228644) [ 3426.320199] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3426.749676] LustreError: 129859:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3426.767812] LustreError: 129859:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3426.819868] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3430.601583] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3431.908348] LustreError: 129860:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3437.029663] LustreError: 129859:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3438.771061] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3443.586570] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3450.931660] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3456.690812] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3464.143503] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3464.596519] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3464.607235] Lustre: Skipped 1 previous similar message [ 3471.018652] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3477.623935] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3491.360645] Lustre: *** cfs_fail_loc=159, val=0*** [ 3508.063885] Lustre: lustre-MDT0000: Client f21ce6fa-8c91-4f58-9451-fc28e4c75140 (at 192.168.203.2@tcp) reconnecting [ 3510.023690] Lustre: *** cfs_fail_loc=159, val=0*** [ 3510.032553] Lustre: Skipped 5 previous similar messages [ 3525.445977] Lustre: lustre-MDT0000: Client f21ce6fa-8c91-4f58-9451-fc28e4c75140 (at 192.168.203.2@tcp) reconnecting [ 3530.808886] Lustre: server umount lustre-OST0000 complete [ 3535.335449] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3535.341738] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3535.353549] Lustre: Skipped 1 previous similar message [ 3535.369851] Lustre: Skipped 2 previous similar messages [ 3544.599633] Lustre: server umount lustre-MDT0000 complete [ 3545.569389] LustreError: 129859:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3545.588829] LustreError: 129859:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3548.372544] LustreError: 129841:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228775 with bad export cookie 10940123372703087801 [ 3548.374396] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3548.384049] LustreError: 129841:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3559.186650] Lustre: server umount lustre-MDT0001 complete [ 3568.856404] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 3571.413797] Key type lgssc unregistered [ 3571.660649] LNet: 133665:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3571.664570] LNetError: 133665:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3571.681320] LNet: Removed LNI 192.168.203.102@tcp [ 3572.460935] Key type .llcrypt unregistered [ 3572.467501] Key type ._llcrypt unregistered [ 3594.269501] Key type ._llcrypt registered [ 3594.276121] Key type .llcrypt registered [ 3594.398754] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 3595.124133] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3595.146749] alg: No test for adler32 (adler32-zlib) [ 3596.203921] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 3596.355857] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 3598.033745] Key type lgssc registered [ 3599.021845] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3605.281840] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3605.313955] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3606.773372] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3610.778331] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3616.227689] LustreError: 135077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3616.248594] LustreError: 135077:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3618.150472] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3618.508588] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3621.987212] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3627.432754] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3631.645940] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3638.290980] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3638.840403] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3647.137904] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3652.186155] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3655.895483] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3666.319640] Lustre: *** cfs_fail_loc=159, val=0*** [ 3682.654492] Lustre: lustre-MDT0000: Client 51b6cde8-1f4c-4009-b166-1ea923b8114c (at 192.168.203.2@tcp) reconnecting [ 3685.218798] Lustre: *** cfs_fail_loc=159, val=0*** [ 3700.654925] Lustre: lustre-MDT0001: Client 51b6cde8-1f4c-4009-b166-1ea923b8114c (at 192.168.203.2@tcp) reconnecting [ 3702.800140] Lustre: *** cfs_fail_loc=159, val=0*** [ 3702.801874] Lustre: Skipped 3 previous similar messages [ 3718.494791] Lustre: lustre-MDT0001: Client 51b6cde8-1f4c-4009-b166-1ea923b8114c (at 192.168.203.2@tcp) reconnecting [ 3723.029840] Lustre: 138115:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3726.438255] Lustre: *** cfs_fail_loc=159, val=0*** [ 3726.454955] Lustre: Skipped 4 previous similar messages [ 3743.060316] Lustre: lustre-MDT0000: Client 7129b11d-70f0-40a5-af1c-39ba9578b932 (at 192.168.203.2@tcp) reconnecting [ 3745.032941] Lustre: *** cfs_fail_loc=159, val=0*** [ 3745.045644] Lustre: Skipped 15 previous similar messages [ 3760.459296] Lustre: lustre-MDT0000: Client 7129b11d-70f0-40a5-af1c-39ba9578b932 (at 192.168.203.2@tcp) reconnecting [ 3761.910676] Lustre: 138402:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3767.790050] LustreError: lustre-OST0000-osc-MDT0001: operation ost_destroy to node 0@lo failed: rc = -107 [ 3767.794774] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3767.805676] LustreError: Skipped 2 previous similar messages [ 3767.818801] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3769.826792] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3769.842916] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3769.847363] LustreError: Skipped 1 previous similar message [ 3769.847420] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3769.893096] Lustre: Skipped 1 previous similar message [ 3773.389159] Lustre: server umount lustre-OST0000 complete [ 3777.506364] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3777.515985] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3777.542803] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3780.071647] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3780.074447] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3783.800067] Lustre: server umount lustre-MDT0000 complete [ 3785.191902] LustreError: 135807:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3785.210041] LustreError: 135807:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3786.982303] LustreError: 135058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229013 with bad export cookie 3957689410329980886 [ 3786.983121] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3786.997464] LustreError: 135058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3787.271582] Lustre: server umount lustre-MDT0001 complete [ 3799.287087] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 3801.981477] Key type lgssc unregistered [ 3802.239647] LNet: 139453:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3802.253030] LNetError: 139453:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3802.277952] LNet: Removed LNI 192.168.203.102@tcp [ 3803.180536] Key type .llcrypt unregistered [ 3803.184826] Key type ._llcrypt unregistered [ 3825.868952] Key type ._llcrypt registered [ 3825.872756] Key type .llcrypt registered [ 3825.993294] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 3826.995271] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3827.117328] alg: No test for adler32 (adler32-zlib) [ 3828.201880] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 3828.441859] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 3830.137893] Key type lgssc registered [ 3831.303503] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3838.077795] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3838.094500] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3839.514830] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3844.020373] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3849.701586] LustreError: 140868:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3849.729975] LustreError: 140868:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3852.499849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3852.847355] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3857.408714] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3864.378874] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3869.868870] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3876.706533] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3877.016099] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3878.078938] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3884.473575] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 3885.230490] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3893.788607] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3901.686316] Lustre: 143452:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3905.440209] Lustre: 143501:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3907.216791] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3908.501419] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3912.921347] Lustre: 143648:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3914.169688] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3915.405305] Lustre: 143746:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3921.376529] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3921.381633] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3921.406557] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3921.412346] Lustre: Skipped 1 previous similar message [ 3921.430255] Lustre: Skipped 1 previous similar message [ 3926.475301] Lustre: server umount lustre-OST0000 complete [ 3931.620907] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3931.638691] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3931.657336] Lustre: Skipped 1 previous similar message [ 3936.619309] Lustre: server umount lustre-MDT0000 complete [ 3936.761412] LustreError: 140863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3936.775212] LustreError: 140863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3940.831255] LustreError: 143550:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229167 with bad export cookie 3846248538091823594 [ 3940.834169] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3940.857023] LustreError: 143550:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3941.253169] Lustre: server umount lustre-MDT0001 complete [ 3953.619442] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 3956.800837] Key type lgssc unregistered [ 3957.132147] LNet: 144810:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3957.139701] LNetError: 144810:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3958.189873] LNet: Removed LNI 192.168.203.102@tcp [ 3959.095394] Key type .llcrypt unregistered [ 3959.098204] Key type ._llcrypt unregistered [ 3986.548035] Key type ._llcrypt registered [ 3986.550753] Key type .llcrypt registered [ 3986.657986] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 3988.136748] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3988.178632] alg: No test for adler32 (adler32-zlib) [ 3989.362603] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 3989.797548] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 3991.591197] Key type lgssc registered [ 3993.140563] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4001.783340] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4001.842620] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4003.352059] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4008.026918] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4013.545665] LustreError: 146224:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4013.565537] LustreError: 146224:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4017.717070] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4018.069658] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4023.135476] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4031.066234] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4037.289093] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4045.033355] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4045.502548] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4048.571128] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4052.132958] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4060.053992] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4062.902138] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4070.281494] Lustre: *** cfs_fail_loc=159, val=0*** [ 4085.572062] Lustre: lustre-MDT0000: Client b84fc497-a4b5-4d22-a273-fb11471fcd04 (at 192.168.203.2@tcp) reconnecting [ 4093.924485] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4093.934533] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4093.946675] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4098.503564] Lustre: server umount lustre-OST0000 complete [ 4104.166430] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4104.182475] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4104.189516] Lustre: Skipped 2 previous similar messages [ 4104.196856] Lustre: Skipped 1 previous similar message [ 4109.033926] Lustre: server umount lustre-MDT0000 complete [ 4109.282940] LustreError: 147589:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4109.317104] LustreError: 147589:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4113.105880] LustreError: 146966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229339 with bad export cookie 11746742062366280835 [ 4113.122827] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4113.123580] LustreError: 146966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4113.641884] Lustre: server umount lustre-MDT0001 complete [ 4126.246850] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 4129.916630] Key type lgssc unregistered [ 4130.191548] LNet: 149888:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4130.196558] LNetError: 149888:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4130.212472] LNet: Removed LNI 192.168.203.102@tcp [ 4131.181323] Key type .llcrypt unregistered [ 4131.183722] Key type ._llcrypt unregistered [ 4157.574971] Key type ._llcrypt registered [ 4157.577423] Key type .llcrypt registered [ 4157.760391] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 4159.466436] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4159.552902] alg: No test for adler32 (adler32-zlib) [ 4160.728272] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 4161.124245] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 4162.887148] Key type lgssc registered [ 4164.465723] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4173.268703] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4173.299834] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4175.166639] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4180.189140] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4184.557173] LustreError: 151302:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4184.599728] LustreError: 151302:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4189.674524] LustreError: 151303:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4191.610706] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4192.363715] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4197.834360] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4207.750110] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4214.708898] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4221.977078] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4222.303305] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4228.689291] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4236.185053] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4236.668985] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4244.887158] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4266.747896] Lustre: lustre-OST0000: evicting 388aa414-5c8c-4da3-b568-ba58b217488e (at 192.168.203.2@tcp) by administrative request [ 4266.764952] Lustre: Skipped 1 previous similar message [ 4296.161691] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4296.164786] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4296.184807] Lustre: Skipped 1 previous similar message [ 4296.185530] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4296.190681] Lustre: Skipped 1 previous similar message [ 4301.281756] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4301.295137] Lustre: Skipped 1 previous similar message [ 4302.367873] Lustre: server umount lustre-OST0000 complete [ 4306.401014] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4306.411557] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4306.426113] Lustre: Skipped 1 previous similar message [ 4306.439306] Lustre: Skipped 1 previous similar message [ 4311.520841] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4311.526152] Lustre: Skipped 1 previous similar message [ 4312.664700] Lustre: server umount lustre-MDT0000 complete [ 4316.112863] LustreError: 151284:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229542 with bad export cookie 6793189188214670265 [ 4316.116833] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4316.129030] LustreError: 151284:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4316.512838] Lustre: server umount lustre-MDT0001 complete [ 4327.098263] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 4329.725368] Key type lgssc unregistered [ 4329.962712] LNet: 155398:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4329.975345] LNetError: 155398:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4329.990878] LNet: Removed LNI 192.168.203.102@tcp [ 4330.969493] Key type .llcrypt unregistered [ 4330.972722] Key type ._llcrypt unregistered [ 4395.680875] Key type ._llcrypt registered [ 4395.683282] Key type .llcrypt registered [ 4395.761823] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 4396.551928] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4396.616806] alg: No test for adler32 (adler32-zlib) [ 4397.657405] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 4397.868943] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 4399.575406] Key type lgssc registered [ 4400.487279] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4407.552709] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4407.576822] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4409.071254] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4412.692251] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4418.529471] LustreError: 157864:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4418.550129] LustreError: 157864:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4420.250766] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4420.768276] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4424.879719] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4431.027715] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4436.192652] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4442.538817] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4442.990389] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4446.081222] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4449.337774] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4453.261808] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4457.526503] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4468.713289] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4468.721347] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4468.726208] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4468.752893] Lustre: Skipped 1 previous similar message [ 4473.152980] Lustre: server umount lustre-OST0000 complete [ 4476.898596] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4476.912216] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4476.942524] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4476.947871] Lustre: Skipped 1 previous similar message [ 4478.944345] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4478.954352] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4483.104762] Lustre: server umount lustre-MDT0000 complete [ 4484.070852] LustreError: 157864:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4484.097637] LustreError: 157864:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4486.795426] LustreError: 157846:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229713 with bad export cookie 3098696413510969993 [ 4486.802681] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4486.808024] LustreError: 157846:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4487.205956] Lustre: server umount lustre-MDT0001 complete [ 4497.366290] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 4500.236251] Key type lgssc unregistered [ 4500.558555] LNet: 161406:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4500.575194] LNetError: 161406:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4500.592217] LNet: Removed LNI 192.168.203.102@tcp [ 4501.356396] Key type .llcrypt unregistered [ 4501.358481] Key type ._llcrypt unregistered [ 4525.717456] Key type ._llcrypt registered [ 4525.720228] Key type .llcrypt registered [ 4525.827882] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 4527.122119] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4527.149629] alg: No test for adler32 (adler32-zlib) [ 4528.101687] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 4528.353173] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 4530.103177] Key type lgssc registered [ 4531.113605] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4545.153327] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 11:49:29 (1782229769) [ 4562.039949] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 4572.103439] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 4608.968160] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4609.010047] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4610.364727] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4610.425865] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4610.565851] Lustre: lustre-MDT0000: new disk, initializing [ 4610.688186] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4610.710801] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4615.130320] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4626.442966] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4626.610629] Lustre: 165676:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4626.677175] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4626.680685] Lustre: Skipped 1 previous similar message [ 4626.744559] Lustre: lustre-MDT0001: new disk, initializing [ 4626.886808] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4626.967348] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4626.990372] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4631.429937] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4640.843941] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4646.775524] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4653.907988] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4654.174487] Lustre: lustre-OST0000: new disk, initializing [ 4654.179600] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4654.188428] Lustre: 167641:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4654.270536] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4660.486896] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4664.448323] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4664.461537] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4664.592195] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4669.911758] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4680.176784] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4680.179996] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4680.189805] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4680.190361] Lustre: Skipped 1 previous similar message [ 4680.214864] LustreError: Skipped 1 previous similar message [ 4685.418950] Lustre: server umount lustre-OST0000 complete [ 4690.404326] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4690.409940] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4690.418926] Lustre: Skipped 1 previous similar message [ 4690.440349] Lustre: Skipped 2 previous similar messages [ 4695.522068] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4695.531633] Lustre: Skipped 1 previous similar message [ 4695.915042] Lustre: server umount lustre-MDT0000 complete [ 4699.741033] LustreError: 165667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229926 with bad export cookie 9160057526051336882 [ 4699.746488] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4699.757523] LustreError: 165667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4700.259493] Lustre: server umount lustre-MDT0001 complete [ 4710.601931] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 4713.493496] Key type lgssc unregistered [ 4713.751183] LNet: 169546:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4713.765854] LNetError: 169546:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4714.790949] LNet: Removed LNI 192.168.203.102@tcp [ 4715.802450] Key type .llcrypt unregistered [ 4715.806496] Key type ._llcrypt unregistered [ 4738.031695] Key type ._llcrypt registered [ 4738.035340] Key type .llcrypt registered [ 4738.127732] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 4739.140962] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4739.299512] alg: No test for adler32 (adler32-zlib) [ 4740.300559] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 4740.475524] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 4742.143608] Key type lgssc registered [ 4743.032070] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4750.185484] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4750.208871] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4751.531113] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4755.903966] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4762.091226] LustreError: 170959:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4762.116247] LustreError: 170959:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4763.882749] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4764.266651] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4768.196348] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4773.959967] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4777.891136] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4783.703281] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4784.113861] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4791.490151] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 4796.428633] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4798.891199] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4806.203616] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4806.223358] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4806.237326] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4806.247573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4806.266323] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4807.224900] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4807.258569] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4807.279412] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4807.290599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.316781] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4808.391709] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4808.407671] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4808.424198] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4808.432660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4808.445116] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4809.489796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.357257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4811.363680] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4811.369817] Lustre: Skipped 2 previous similar messages [ 4811.388745] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4811.399641] Lustre: Skipped 2 previous similar messages [ 4811.403697] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4811.408492] Lustre: Skipped 2 previous similar messages [ 4811.411773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4811.420911] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4811.427932] Lustre: Skipped 2 previous similar messages [ 4812.394639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.326983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.363068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.451859] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4815.457316] Lustre: Skipped 3 previous similar messages [ 4815.474423] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4815.486477] Lustre: Skipped 3 previous similar messages [ 4815.490618] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4815.493859] Lustre: Skipped 3 previous similar messages [ 4815.497531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.505303] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4815.517748] Lustre: Skipped 3 previous similar messages [ 4816.424756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.314414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.091876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.956879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.881333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.803780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.658930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.619535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.568401] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4823.576230] Lustre: Skipped 8 previous similar messages [ 4823.593873] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4823.601355] Lustre: Skipped 8 previous similar messages [ 4823.603973] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4823.608222] Lustre: Skipped 8 previous similar messages [ 4823.610981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.624639] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4823.628884] Lustre: Skipped 8 previous similar messages [ 4824.603684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.473789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.443644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.427651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.470526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.405197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.475465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.454051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.270720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.105597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.792581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.677089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.412877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.147682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.954921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.622143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.448216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.147514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.872667] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4839.880076] Lustre: Skipped 18 previous similar messages [ 4839.893504] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4839.901957] Lustre: Skipped 18 previous similar messages [ 4839.906479] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4839.910434] Lustre: Skipped 18 previous similar messages [ 4839.915830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.924979] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4839.932896] Lustre: Skipped 18 previous similar messages [ 4840.787490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.778373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.684206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.542258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.382229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.286208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.072781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.892379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.809830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.625448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.292309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.000424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.742559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.571478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.338640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.039246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.787663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.655137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4855.573848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.283747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.022803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.910461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.664848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.470414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.195720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.007876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.804931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.610070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.415148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.235869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.023628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.825067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.660042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.644319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.389900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.243556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.052178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.952650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.940512] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4871.952560] Lustre: Skipped 38 previous similar messages [ 4871.975745] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4871.989293] Lustre: Skipped 38 previous similar messages [ 4872.000211] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4872.007264] Lustre: Skipped 38 previous similar messages [ 4872.010883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.021262] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4872.027695] Lustre: Skipped 38 previous similar messages [ 4872.727882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.719911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.645939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.479575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.546801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.576944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.573671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.444164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.418988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.266211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.133922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.106605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.956981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.901679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.797642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.695180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.674899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.491534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.367918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.181537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.999898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.969902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.976988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.787893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.663582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.614946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.478324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.367912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.348153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.162846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.924770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.702411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4901.675853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.498518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.366439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.068553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.917769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.900768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.710357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.547589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.327513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.080593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.862938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.642683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.528650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.336091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.226399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.142762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.128822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.036868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.958253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.785518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.499281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.351527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.169528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.869380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.604367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.291400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.107429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.792121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.589637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.438611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.166599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.967762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.760336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.562949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.444801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.515970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.255223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.135292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.136723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.990583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.862987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.718283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.498305] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4936.509788] Lustre: Skipped 74 previous similar messages [ 4936.538411] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4936.550640] Lustre: Skipped 74 previous similar messages [ 4936.558585] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4936.568803] Lustre: Skipped 74 previous similar messages [ 4936.577590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.596376] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4936.610093] Lustre: Skipped 74 previous similar messages [ 4937.384928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4938.307991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.126487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.964387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.700069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4941.622415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.510590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4943.325303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.243392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.091236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.810856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.637614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.397920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.133549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.809977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.442758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.208062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.925329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.776500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.607704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4953.598829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.441154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.549754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.417274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.269898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.051255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.834390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.564355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.373234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.146934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.825215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.569868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.160191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.967614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.802163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.710311] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4965.717184] LustreError: 170979:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4965.729053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.562949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.464706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.466680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.442932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.231581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.257758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.200354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4973.282333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.383391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.223959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.000381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.709634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.486795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.180144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.872337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.572079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.379856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.092465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.890834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4982.660308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.528442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.395932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.245854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.048396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.977132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.822649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.646790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.351573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.149654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.819355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.747620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.604291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.423260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.198656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.873204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.634645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.626669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.505552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.391477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.259835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.206941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.207754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.165519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.051796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.919540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.747513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.660100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.486769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.360406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.442595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.581314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.535886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.732056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.876536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.901325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.806973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.717186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.661832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.487032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.395207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.174138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.137153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.879864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.632808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.373645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.013050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.868586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.766888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.727355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.562275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.550469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.452336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.364715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.157705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.081432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.881724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.782736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.692678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.648730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.608617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.488691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.302286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.205208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.000425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.854686] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5039.868638] LustreError: 170979:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5039.879301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.711691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.630925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.349166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.254485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.009940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.753631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.445657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.291572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5047.136050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.004602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.784840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.579079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.298679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.098501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.851491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.697661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.410489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.238025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.046128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.763504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.493289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.376239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.181880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.207670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.980687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.778907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.602101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.554775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.341395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.278663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.978659] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5064.983828] Lustre: Skipped 151 previous similar messages [ 5064.996543] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5065.005127] Lustre: Skipped 151 previous similar messages [ 5065.008474] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5065.013170] Lustre: Skipped 151 previous similar messages [ 5065.019690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5065.033191] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5065.037783] Lustre: Skipped 151 previous similar messages [ 5065.810508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.586717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.575980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.503683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.451983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.302995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.518058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.748662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.974396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.957690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.030954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.986951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.018863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.790401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.591109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.306611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.150103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.962094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.835694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.790792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.710404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.637809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5086.563950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.467529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.406595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.274161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.202542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.852962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.768067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.669775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5093.722383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.536552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.413228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.406603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.315237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.204562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.914855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.851707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.572708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.472882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.425817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.478139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.269675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.123846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.051629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.880992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.704224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.543295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.327393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.227495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.951173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.955976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.708241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.576621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.401830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.154889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.084147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.032592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.984635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.969786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.856732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.701716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.579424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.411678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.290193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.177968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.223929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.236547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.162940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.079914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.974650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5129.808166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5130.591059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.496948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.444238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5133.492256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.472649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.418446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.219547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.005133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.801919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.592435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.436559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.395289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.235275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.961929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.758439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.546199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.480293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.247504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.229840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.155514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.056711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.904965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.799922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.575594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.448719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.261965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.162827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.962941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.776481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.620127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.514111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.312102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.095092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.996684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.844119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.686426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.774456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.715121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.563244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.322711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.236591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.323395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.139268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.022666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.823947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.667967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.416634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.247616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.003157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.928792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.825892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.714889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.545806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.338920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.182869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.026313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.855050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.829079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.776941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.688746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.512029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.555304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.205391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.930225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.831567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.581127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.387790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.321119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.242396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.056178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.973378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.914757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.811170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.792197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.896180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.889539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.825285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.788349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.873748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.806203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.761864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.775382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.115063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5204.338730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.186562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.956551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.697227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.482500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.337926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.244423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.092469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.952724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.864738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.699334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.567683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5214.455582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.355575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.562760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.691317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.499969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.508605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.337111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.212353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.861518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.720436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.569670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.418787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.090976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.886790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.687586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.610497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.336800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.158436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.969073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.148888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.130612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.097178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.890949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.822870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.014350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.014876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.843326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.696789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.682199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.691783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.652489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.487276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.279169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.193916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.064362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.865870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.798123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.552398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.454040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.363089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.120039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.914169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.843687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.656771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.413682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5254.179363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.026935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.928862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.746695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.480831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.354083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.166602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.952492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.768286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.561899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.419907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5263.244348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.145755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.177028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.252415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.403076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5268.537347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.400484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.353172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.157930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.277664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.249705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.138624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.224688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.351855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.402882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.527784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.695046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.533364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.666415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.717309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.559752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.660438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.795084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5286.669644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.480743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.328661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.749700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5291.404134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.750559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.138936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.352428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.684680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.907426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.994375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.979446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5300.967074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.138472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.340503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.444919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.660718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5306.782778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.140534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.458600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5310.897567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.192724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.339092] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5313.358756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.363080] LustreError: 170979:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5314.391325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.419556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.759700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5317.931735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.004642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.981976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5320.981174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.890885] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5321.916130] Lustre: Skipped 276 previous similar messages [ 5321.937780] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5321.967296] Lustre: Skipped 276 previous similar messages [ 5321.988578] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5321.997064] Lustre: Skipped 276 previous similar messages [ 5322.003064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.036030] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5322.051370] Lustre: Skipped 276 previous similar messages [ 5322.985816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.005943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.132777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.002511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.883889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.719511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.744570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5329.585227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.395116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.271180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.193545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.180679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.161713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.986263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.725642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.600791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.400940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5338.208718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.103778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.027437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.795665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.747940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.540324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.429813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.304748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.191730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.086826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.950964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.756851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5348.704238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.610068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.803258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.919359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.214217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.236404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.386080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.141851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.079770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5358.132836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.062857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.009491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.941157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.051602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5363.162920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.408224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5365.512950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.418691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.200274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.017146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.080363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.842688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.842507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.747290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.640903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.486137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.288508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.217662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.093450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.102111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.960100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.011882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.972329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.123983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.906308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.963202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5383.778611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.796914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5386.221574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.060974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.961901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5388.818312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.834927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.794888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.591432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5392.478994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5393.462525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5394.455563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.470228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.287474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5397.272681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.040295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.106859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.060766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.009534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.942109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5403.384885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5404.564504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.651088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.766276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.947620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.770027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.682295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5410.705678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.681977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.612357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5413.473637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.452879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.525061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.496912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.528719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5418.558147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.747050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.881469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.077538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.990323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.802265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.835816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5425.647914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.441119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.483496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.384772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.309105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.185978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.018337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.834239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.678490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.474152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.419466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.265826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.194769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.094264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5438.075987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5438.848233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.767405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.732651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.616454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.459211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.319749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.173635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5445.088768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.062335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.071382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5448.080480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.103032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.988572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5450.934688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.897599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.866146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.765250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5454.742585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.728485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.761821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5457.775059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.678935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5459.473666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.372063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.224262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.050807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.999260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.978607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.781353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.700696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.578611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.560429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.486298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.330987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.303714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.236836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.192850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5473.172758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.156865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.998983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.906950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5476.690023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5477.696742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.848353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.094411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.322499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.511773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.517313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.318246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.161963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.130838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.834240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.614304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.454292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.298086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.224176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.990665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.884657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.795522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.666252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.716105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.616126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.569716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.557149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.609589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5499.467098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.519509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.661840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.651776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.598967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.456338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.215357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.155344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.109256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.178411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.219733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.331595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.394030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.327455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.448205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.508122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.435938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.694651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.895928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.184704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.293342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.496635] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5521.516404] LustreError: 170979:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5521.535072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.750697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.819090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.742909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.790436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.621254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.706553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.775354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.859263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.050599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.026412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.082888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.035036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.153419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.374319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.348978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.599996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.559256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.856566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.245058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.253708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.294923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.292258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.352165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.377216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.348637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.321787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.426068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.460535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.454158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.528420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.582623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.759801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.897955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.007080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.353700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.463514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.637774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.785430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.814703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.152805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.196215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.307755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.584824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.633779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.861897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.770537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.827877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.759798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.912249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.050876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.947641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.021406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.018907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.051115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.024688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.106148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.058829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.030924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.852622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.982746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.114440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.250881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.491373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.570547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.550684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.576714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.649783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.609185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.594959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.587656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.470645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.499341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.441340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.561168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.409581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.422673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.313443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.454474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.618500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.614794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.743439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.921865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.988628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.791422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.705391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.546460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.517151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.364585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.185564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.119976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.127869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.044963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.168743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.059971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.098496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.085651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.073957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.976909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.831303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.714576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.661768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.672703] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5627.685437] LustreError: 170979:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5627.706176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.787739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.909197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.738363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.806763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.624600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.686324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.561872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.699666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.785399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.576380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.559460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.521883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.442169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.628279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.669377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.773152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.970250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.017790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.026578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.001578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.857285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.922768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.959093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.785062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.589103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.522691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.416296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.516166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.547475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.625587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.545254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.496345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.404060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.360333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.288134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.319236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.325472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.336728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.149328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5667.154819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.063664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.954547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.865851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.866140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.740501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.706600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.582604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.518445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.303726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.185345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.208848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.166403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.219549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.056810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.917805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.965450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.049626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.961483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.924391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.800227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.811846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.747468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.575941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.325251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.254070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.166858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.307940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.218137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.226984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.175655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.291724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.171518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.207469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.150762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.135588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.965566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.035895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.895492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.858861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.963044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.118574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.913447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.743716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.647850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.580743] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5709.590221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.590754] LustreError: 170979:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5710.557281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.470195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.226296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.211257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.978921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.730709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.639357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.529432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.569027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.456695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.426228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.232981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.072327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.919840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.858256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.717324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.808801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.829930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.018184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.878236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.734704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.479408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.435577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.037751] LustreError: 172779:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6042.044233] LustreError: 170979:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6412.256310] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6412.278082] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6412.286401] Lustre: Skipped 419 previous similar messages [ 6412.291532] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6413.284109] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6413.291683] Lustre: Skipped 1 previous similar message [ 6414.975140] Lustre: server umount lustre-OST0000 complete [ 6417.890306] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6417.898795] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6423.521556] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6423.534638] Lustre: Skipped 3 previous similar messages [ 6428.640029] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6428.652991] Lustre: Skipped 1 previous similar message [ 6432.224470] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6432.505212] Lustre: server umount lustre-MDT0000 complete [ 6433.770560] LustreError: 170960:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6433.807471] LustreError: 170960:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6436.008934] LustreError: 170940:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782231662 with bad export cookie 16579170568700429107 [ 6436.021324] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6436.025294] LustreError: 170940:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6436.493718] Lustre: server umount lustre-MDT0001 complete [ 6444.223877] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 6446.462907] Key type lgssc unregistered [ 6446.732900] LNet: 226162:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6446.742256] LNetError: 226162:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6446.757201] LNet: Removed LNI 192.168.203.102@tcp [ 6447.531794] Key type .llcrypt unregistered [ 6447.535728] Key type ._llcrypt unregistered [ 6466.049409] Key type ._llcrypt registered [ 6466.053719] Key type .llcrypt registered [ 6466.127324] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 6466.702458] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6466.726356] alg: No test for adler32 (adler32-zlib) [ 6467.702436] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 6467.915038] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 6469.568143] Key type lgssc registered [ 6470.414918] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6476.137934] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6476.153485] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6477.485398] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6480.900672] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6486.565819] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6486.811119] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6489.505692] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6494.305452] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6498.241531] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6502.938078] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6503.181030] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6507.136361] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6508.524763] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 6512.032202] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6515.793303] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6517.106210] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6517.114289] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6517.119435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6517.127288] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6517.128673] LustreError: 227579:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6518.563150] Lustre: lustre-OST0000: Not available for connect from 192.168.203.2@tcp (stopping) [ 6518.753690] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6518.766046] Lustre: Skipped 1 previous similar message [ 6523.660377] Lustre: lustre-OST0000: Not available for connect from 192.168.203.2@tcp (stopping) [ 6523.666522] Lustre: Skipped 2 previous similar messages [ 6524.616654] Lustre: server umount lustre-OST0000 complete [ 6537.151333] LustreError: 227579:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6555.204580] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6555.412241] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6558.852246] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6563.425694] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6573.860355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6573.878320] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6573.878455] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6573.894446] Lustre: Skipped 1 previous similar message [ 6575.217464] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 10 sec [ 6578.599918] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9bcc0396a000.ost_server_uuid 50 [ 6579.485514] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9bcc0396a000.ost_server_uuid in FULL state after 0 sec [ 6584.291445] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6584.293887] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6584.307336] Lustre: Skipped 1 previous similar message [ 6584.307856] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6584.328572] Lustre: Skipped 3 previous similar messages [ 6587.721406] Lustre: server umount lustre-OST0000 complete [ 6594.529556] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6594.533173] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6594.534406] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6594.537414] Lustre: Skipped 1 previous similar message [ 6594.552432] Lustre: Skipped 1 previous similar message [ 6599.648872] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6599.653326] Lustre: Skipped 1 previous similar message [ 6604.255118] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6604.344791] Lustre: server umount lustre-MDT0000 complete [ 6604.769416] LustreError: 227559:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6604.787313] LustreError: 227559:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6606.474808] LustreError: 227538:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782231833 with bad export cookie 8610217811916521381 [ 6606.478335] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6606.485084] LustreError: 227538:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6606.690365] Lustre: server umount lustre-MDT0001 complete [ 6613.417371] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 6615.233633] Key type lgssc unregistered [ 6615.434373] LNet: 232783:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6615.439292] LNetError: 232783:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6615.451698] LNet: Removed LNI 192.168.203.102@tcp [ 6615.994348] Key type .llcrypt unregistered [ 6615.996056] Key type ._llcrypt unregistered [ 6636.544964] Key type ._llcrypt registered [ 6636.547624] Key type .llcrypt registered [ 6636.616624] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 6637.201992] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6637.226173] alg: No test for adler32 (adler32-zlib) [ 6638.149540] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 6638.286586] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 6639.911164] Key type lgssc registered [ 6640.658241] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6646.928629] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6646.947871] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6648.250272] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6650.745989] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6655.939515] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6656.174560] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6658.790933] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6660.934619] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6665.520305] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6665.755783] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6670.066794] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6673.975877] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 6676.157973] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6676.248793] Lustre: lustre-OST0001: new disk, initializing [ 6676.252906] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6676.258758] Lustre: 236797:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6676.325093] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6680.024177] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6684.739236] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6684.750512] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6684.839469] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6688.528328] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6694.117278] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 6706.574916] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [ 6706.580258] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6706.587341] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6706.773436] Lustre: server umount lustre-MDT0000 complete [ 6709.779905] LustreError: 234470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782231936 with bad export cookie 5740313395474728870 [ 6709.798774] LustreError: 235227:0:(osp_object.c:629:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 6709.802140] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6710.037996] Lustre: server umount lustre-MDT0001 complete [ 6726.239507] Lustre: 233755:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782231937/real 1782231937] req@ffff8bfba3e5d500 x1868805560160128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782231953 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6726.262577] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6730.719137] Lustre: 233756:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782231941/real 1782231941] req@ffff8bfb8ea00380 x1868805560160640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782231957 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6730.739508] Lustre: 233756:0:(client.c:2489:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 6732.865044] Lustre: server umount lustre-OST0000 complete [ 6735.411503] Lustre: server umount lustre-OST0001 complete [ 6749.032250] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 6754.662547] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6754.930121] LustreError: 239900:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6754.943866] LustreError: 239900:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6754.977060] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6757.604048] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6760.420782] LustreError: 239901:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6762.770882] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6765.429819] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6767.442837] Lustre: 241040:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6771.171091] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6771.373549] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6771.377796] Lustre: Skipped 1 previous similar message [ 6772.390912] LustreError: 241395:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6772.399264] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 6774.723727] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6777.830896] LustreError: 241395:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6779.752710] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6779.888034] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 6783.475608] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6788.599801] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6790.559380] Lustre: 242907:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6798.817072] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6798.824252] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6798.838278] Lustre: Skipped 1 previous similar message [ 6798.843637] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6800.356825] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6800.364306] Lustre: Skipped 3 previous similar messages [ 6804.370994] Lustre: server umount mylustre-MDT0000 complete [ 6805.477508] LustreError: 239896:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6805.491694] LustreError: 239896:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6806.223439] LustreError: 242910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232033 with bad export cookie 5740313395474731719 [ 6806.227337] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6806.233547] LustreError: 242910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6806.419682] Lustre: server umount mylustre-MDT0001 complete [ 6818.844701] Lustre: server umount mylustre-OST0000 complete [ 6831.166458] Lustre: server umount mylustre-OST0001 complete [ 6843.317618] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 6849.205408] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6849.458550] LustreError: 245219:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6849.506745] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6849.510897] Lustre: Skipped 1 previous similar message [ 6851.734123] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6856.705492] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6859.393919] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6861.328384] Lustre: 246364:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6865.873095] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6867.105825] LustreError: 246717:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6867.120798] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 6867.124149] LustreError: 246717:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6870.168803] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6874.610411] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 6876.040161] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6880.111571] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6885.200675] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6887.591476] Lustre: 248229:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6893.026416] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6893.031877] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6893.042022] Lustre: Skipped 3 previous similar messages [ 6893.050302] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 6897.824611] Lustre: server umount tfs-MDT0000 complete [ 6900.350979] LustreError: 245965:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232127 with bad export cookie 5740313395474733665 [ 6900.353584] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6900.361330] LustreError: 245965:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6900.579826] Lustre: server umount tfs-MDT0001 complete [ 6912.472637] Lustre: server umount tfs-OST0000 complete [ 6924.468369] Lustre: server umount tfs-OST0001 complete [ 6938.248209] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 6944.778246] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6945.044819] LustreError: 250481:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6945.056233] LustreError: 250481:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6945.100750] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6945.105266] Lustre: Skipped 3 previous similar messages [ 6947.689580] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6952.718580] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6955.526595] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6957.455084] Lustre: 251622:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6961.501645] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6962.806718] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 6965.408837] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6969.328269] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 6971.157594] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6975.256074] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 6980.365923] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6982.527791] Lustre: 253490:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6986.558518] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 12:30:11 (1782232211) [ 7002.087135] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7002.087961] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7002.095752] Lustre: Skipped 5 previous similar messages [ 7002.105120] Lustre: Skipped 7 previous similar messages [ 7005.887481] Lustre: server umount lustre-MDT0000 complete [ 7008.207399] LustreError: 250458:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232235 with bad export cookie 5740313395474735366 [ 7008.213230] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7008.217405] LustreError: 250458:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7012.320412] LustreError: 250478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7012.322844] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7012.330164] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7012.335949] LustreError: 250478:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 10 previous similar messages [ 7012.348482] Lustre: Skipped 2 previous similar messages [ 7014.447750] Lustre: server umount lustre-MDT0001 complete [ 7031.263389] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7031.330504] Lustre: server umount lustre-OST0000 complete [ 7039.777277] Lustre: server umount lustre-OST0001 complete [ 7043.419489] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 7049.025313] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 7068.515152] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7068.515152] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7068.515152] [ 7068.535092] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7068.665245] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7068.684889] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7068.738787] Lustre: lustre-MDT0000: new disk, initializing [ 7068.812202] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7068.816860] Lustre: Skipped 3 previous similar messages [ 7068.833810] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7070.979660] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7076.867146] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 7076.867146] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7076.867146] [ 7076.882765] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7076.943355] Lustre: 256669:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7076.979728] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7076.982364] Lustre: Skipped 1 previous similar message [ 7077.026348] Lustre: lustre-MDT0001: new disk, initializing [ 7077.103954] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7077.109953] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7079.033060] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7084.794301] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7084.967121] Lustre: lustre-OST0000: new disk, initializing [ 7084.970397] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7084.975905] Lustre: 258252:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7086.422838] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7086.429945] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7086.471059] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7088.192409] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7093.740831] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7093.854433] Lustre: lustre-OST0001: new disk, initializing [ 7093.857907] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7093.863913] Lustre: 259124:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7095.218700] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7095.229943] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7095.269332] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7096.983664] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7103.067167] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 12:32:08 (1782232328) [ 7110.357682] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 12:32:15 (1782232335) [ 7126.000302] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7126.002900] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7126.007933] Lustre: Skipped 1 previous similar message [ 7126.017850] Lustre: Skipped 4 previous similar messages [ 7128.801113] Lustre: server umount lustre-OST0000 complete [ 7139.209736] Lustre: server umount lustre-MDT0000 complete [ 7141.345786] LustreError: 257474:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7141.359914] LustreError: 257474:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 7141.653423] LustreError: 258251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232368 with bad export cookie 5740313395474736920 [ 7141.656577] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7141.669365] LustreError: 258251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7147.973963] Lustre: server umount lustre-MDT0001 complete [ 7154.563167] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 7167.328412] Lustre: server umount lustre-OST0001 complete [ 7171.510540] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 7181.327173] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 7203.997814] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7204.147521] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7204.172382] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7204.230571] Lustre: lustre-MDT0000: new disk, initializing [ 7204.278302] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7204.282992] Lustre: Skipped 3 previous similar messages [ 7204.296871] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7206.833701] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7213.382892] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7213.457953] Lustre: 263651:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7213.628340] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7216.281156] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7222.039433] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7225.186339] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7229.554603] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7229.702130] Lustre: lustre-OST0000: new disk, initializing [ 7229.704419] Lustre: Skipped 1 previous similar message [ 7229.707656] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7229.711160] Lustre: Skipped 2 previous similar messages [ 7229.715406] Lustre: 265620:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7231.527618] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7231.535552] Lustre: Skipped 1 previous similar message [ 7231.543208] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7231.594628] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7233.190391] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7239.145527] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7246.816957] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7246.817729] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7246.821557] LustreError: Skipped 1 previous similar message [ 7246.822193] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7246.831269] Lustre: Skipped 5 previous similar messages [ 7246.847314] Lustre: Skipped 8 previous similar messages [ 7249.345536] Lustre: server umount lustre-OST0000 complete [ 7266.271143] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7266.376287] Lustre: server umount lustre-MDT0000 complete [ 7268.828288] LustreError: 263644:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232495 with bad export cookie 5740313395474738390 [ 7268.829160] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7268.838957] LustreError: 263644:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7269.043292] Lustre: server umount lustre-MDT0001 complete [ 7275.598859] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 7277.345491] Key type lgssc unregistered [ 7277.528553] LNet: 267379:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7277.534118] LNetError: 267379:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7277.546594] LNet: Removed LNI 192.168.203.102@tcp [ 7278.069159] Key type .llcrypt unregistered [ 7278.074648] Key type ._llcrypt unregistered [ 7293.321587] Key type ._llcrypt registered [ 7293.323576] Key type .llcrypt registered [ 7293.370801] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 7293.830338] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7293.906817] alg: No test for adler32 (adler32-zlib) [ 7294.829155] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 7294.949481] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 7296.551169] Key type lgssc registered [ 7297.095624] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7301.734533] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7301.749224] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7303.012783] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7305.445153] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7310.566138] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7310.807256] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7313.303597] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7317.566706] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7320.751419] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7324.613847] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7324.822236] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7327.916321] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 7328.401632] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7332.619608] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7333.214246] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7335.464346] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7335.464433] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7340.513722] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7340.517369] Lustre: Skipped 1 previous similar message [ 7340.650588] Lustre: server umount lustre-OST0000 complete [ 7345.636363] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7345.638686] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7345.649458] Lustre: Skipped 1 previous similar message [ 7345.662913] Lustre: Skipped 2 previous similar messages [ 7349.011924] Lustre: server umount lustre-MDT0000 complete [ 7350.753113] LustreError: 268815:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7350.765334] LustreError: 268815:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7351.113455] LustreError: 268800:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232577 with bad export cookie 4928790640417437150 [ 7351.114367] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7351.121416] LustreError: 268800:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7351.317686] Lustre: server umount lustre-MDT0001 complete [ 7357.698410] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 7359.730200] Key type lgssc unregistered [ 7359.975308] LNet: 272406:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7359.982608] LNetError: 272406:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7359.999795] LNet: Removed LNI 192.168.203.102@tcp [ 7360.981563] Key type .llcrypt unregistered [ 7360.984951] Key type ._llcrypt unregistered [ 7380.011289] Key type ._llcrypt registered [ 7380.020943] Key type .llcrypt registered [ 7380.140886] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 7382.090227] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7382.141177] alg: No test for adler32 (adler32-zlib) [ 7383.334697] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 7383.794904] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 7385.543143] Key type lgssc registered [ 7386.998486] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7400.173617] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7400.262219] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7416.237565] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7421.471510] LustreError: 273604:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.102@tcp: failed processing log, type 4: rc = -110 [ 7448.351929] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7455.890928] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7463.920605] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7466.352624] Lustre: server umount lustre-OST0000 complete [ 7482.494404] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 7485.465652] Key type lgssc unregistered [ 7485.761795] LNet: 275236:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7485.770697] LNetError: 275236:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7485.816053] LNet: Removed LNI 192.168.203.102@tcp [ 7486.634560] Key type .llcrypt unregistered [ 7486.636052] Key type ._llcrypt unregistered [ 7525.556688] Key type ._llcrypt registered [ 7525.562178] Key type .llcrypt registered [ 7525.686122] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 7526.766115] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7526.825197] alg: No test for adler32 (adler32-zlib) [ 7527.963052] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 7528.273424] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 7529.943158] Key type lgssc registered [ 7530.867097] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7543.437390] loop0: detected capacity change from 0 to 204800000 [ 7543.583993] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7543.609597] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7543.941764] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7545.187557] loop0: detected capacity change from 0 to 204800000 [ 7545.319762] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7545.333330] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7545.650315] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7546.649614] loop0: detected capacity change from 0 to 204800000 [ 7546.874183] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7546.889446] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7547.023452] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7548.062989] loop0: detected capacity change from 0 to 204800000 [ 7548.238563] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7549.432634] loop0: detected capacity change from 0 to 204800000 [ 7549.457187] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7553.470046] loop0: detected capacity change from 0 to 204800000 [ 7553.508867] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7557.516835] loop0: detected capacity change from 0 to 204800000 [ 7557.542572] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7561.503341] loop0: detected capacity change from 0 to 204800000 [ 7561.521817] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7566.203611] loop0: detected capacity change from 0 to 204800000 [ 7566.331774] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7566.411147] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7566.544575] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7566.562636] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 7566.581727] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 7566.600925] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7566.621478] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 7566.641556] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7566.654477] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7566.671624] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 7566.697768] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 7566.713629] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 7566.735546] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 7566.746788] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 7566.762431] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 7566.784758] Lustre: 278650:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 7573.761970] Lustre: server umount MGS complete [ 7574.836582] loop0: detected capacity change from 0 to 204800000 [ 7575.035155] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7575.715818] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7575.786921] Lustre: lustre-MDT0000: Aborting client recovery [ 7576.754512] loop1: detected capacity change from 0 to 204800000 [ 7576.966983] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7577.186876] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7577.199654] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7577.218457] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 7577.240238] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 7577.265477] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7577.290577] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 7577.322590] Lustre: 279084:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7577.374972] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7577.869589] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7577.990670] Lustre: lustre-MDT0001: Aborting client recovery [ 7578.990171] loop2: detected capacity change from 0 to 204800000 [ 7579.252904] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7579.346322] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7579.356831] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7579.372819] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7579.393590] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7579.410227] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7579.426448] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7579.440631] Lustre: 279163:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7579.624807] Lustre: Found index 0 for lustre-OST0000, updating log [ 7579.679610] Lustre: 279181:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7579.797379] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7579.827373] Lustre: lustre-OST0000: Aborting recovery [ 7580.704344] loop3: detected capacity change from 0 to 204800000 [ 7580.855439] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7580.924413] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7580.952399] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7580.976740] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7581.001473] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7581.013649] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7581.027561] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7581.035804] Lustre: 279247:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7581.051350] Lustre: Found index 1 for lustre-OST0001, updating log [ 7581.086168] Lustre: 279252:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7581.193817] Lustre: lustre-OST0001: Aborting recovery [ 7585.277481] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7585.291481] LustreError: 279028:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 7585.343411] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7585.362559] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 7585.438119] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 7587.302771] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 7587.304409] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 7589.541249] LustreError: 278995:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 503us: rc = -2 [ 7590.100964] LustreError: 278995:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 531us: rc = -2 [ 7590.122479] LustreError: 278995:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 17 previous similar messages [ 7603.687053] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7603.694384] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7603.722158] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7607.777284] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7607.788694] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7607.803571] Lustre: Skipped 2 previous similar messages [ 7607.808306] Lustre: Skipped 2 previous similar messages [ 7609.231627] Lustre: server umount lustre-MDT0000 complete [ 7610.337273] LustreError: 278977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782232837 with bad export cookie 18279507936165928580 [ 7610.375915] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7612.913812] LustreError: 278994:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7612.914627] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7612.927791] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7612.927800] Lustre: Skipped 1 previous similar message [ 7612.945650] LustreError: 278994:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7612.972059] Lustre: Skipped 1 previous similar message [ 7615.906125] LustreError: 278992:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7615.908045] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7615.948231] LustreError: 278992:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7615.955956] Lustre: Skipped 2 previous similar messages [ 7616.813897] Lustre: server umount lustre-MDT0001 complete [ 7631.839168] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7631.970961] Lustre: server umount lustre-OST0000 complete [ 7639.584600] Lustre: server umount lustre-OST0001 complete [ 7647.557743] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 12:41:11 (1782232871) [ 7676.513651] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 7686.564576] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 7723.941801] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7724.135984] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7724.159801] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7724.219566] Lustre: lustre-MDT0000: new disk, initializing [ 7724.322310] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7724.331900] Lustre: Skipped 1 previous similar message [ 7724.357093] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7729.016794] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7739.645594] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7739.786836] Lustre: 283320:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7739.846131] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7739.854481] Lustre: Skipped 1 previous similar message [ 7739.916220] Lustre: lustre-MDT0001: new disk, initializing [ 7740.037429] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7740.073892] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7740.085764] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7745.048550] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7755.378325] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7761.617169] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7768.656353] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7768.901855] Lustre: lustre-OST0000: new disk, initializing [ 7768.909186] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7768.920718] Lustre: 285288:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7769.042183] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7774.763049] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7774.776254] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7774.903038] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7775.582772] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7786.202122] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7792.240444] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 7804.307741] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 7812.724569] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 7867.364678] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7867.388891] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7867.394318] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7867.410237] Lustre: Skipped 1 previous similar message [ 7869.317480] Lustre: server umount lustre-OST0000 complete [ 7877.602379] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7877.619896] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7877.624375] Lustre: Skipped 2 previous similar messages [ 7877.638473] Lustre: Skipped 1 previous similar message [ 7879.531492] Lustre: server umount lustre-MDT0000 complete [ 7882.720574] LustreError: 283326:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7882.753300] LustreError: 283326:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7883.217756] LustreError: 283314:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782233110 with bad export cookie 18279507936165931296 [ 7883.224556] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7883.229572] LustreError: 283314:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 7883.557784] Lustre: server umount lustre-MDT0001 complete [ 7891.447344] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7896.396914] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7901.038043] Lustre: server umount MGS complete [ 7912.835580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7913.365740] LustreError: 289200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7913.394189] LustreError: 289213:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 7913.489518] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7918.565273] LustreError: 289201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7918.640200] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7927.749437] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7932.655601] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7940.541390] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7946.308239] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7953.319377] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7953.767307] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7953.776147] Lustre: Skipped 1 previous similar message [ 7959.813658] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 7967.741684] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7998.949732] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7998.967127] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7998.972268] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7998.985655] Lustre: Skipped 1 previous similar message [ 8001.867592] Lustre: server umount lustre-OST0000 complete [ 8012.195381] Lustre: server umount lustre-MDT0000 complete [ 8014.306909] LustreError: 289200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8014.322558] LustreError: 289200:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8015.775528] LustreError: 289182:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782233242 with bad export cookie 18279507936165933158 [ 8015.785378] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8015.787064] LustreError: 289182:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8016.471786] Lustre: server umount lustre-MDT0001 complete [ 8028.277766] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 8030.904502] Key type lgssc unregistered [ 8031.216856] LNet: 293143:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8031.221797] LNetError: 293143:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8031.242977] LNet: Removed LNI 192.168.203.102@tcp [ 8032.111440] Key type .llcrypt unregistered [ 8032.115788] Key type ._llcrypt unregistered [ 8071.488488] Key type ._llcrypt registered [ 8071.491104] Key type .llcrypt registered [ 8071.616002] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 8090.433345] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 8091.449504] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8091.514294] alg: No test for adler32 (adler32-zlib) [ 8092.531834] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 8092.707234] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 8094.439151] Key type lgssc registered [ 8095.766905] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8129.519618] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8129.540494] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8130.828950] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8130.870043] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8130.980382] Lustre: lustre-MDT0000: new disk, initializing [ 8131.085330] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8131.108617] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8135.791336] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8145.876665] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8145.976335] Lustre: 297103:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8146.022723] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8146.027197] Lustre: Skipped 1 previous similar message [ 8146.091178] Lustre: lustre-MDT0001: new disk, initializing [ 8146.175288] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8146.221311] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8146.240396] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8150.243408] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8158.767453] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8164.440919] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8172.637654] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8173.048437] Lustre: lustre-OST0000: new disk, initializing [ 8173.054852] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8173.070077] Lustre: 299072:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8173.203801] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8178.834261] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8178.846295] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8178.991447] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8180.331731] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8191.725510] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8200.204457] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8213.667752] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8218.751059] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8223.209591] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8276.452333] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8276.458147] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8276.465351] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8276.482509] Lustre: Skipped 1 previous similar message [ 8276.498742] Lustre: Skipped 1 previous similar message [ 8279.764772] Lustre: server umount lustre-OST0000 complete [ 8284.641625] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8284.649280] LustreError: Skipped 1 previous similar message [ 8284.654550] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8284.667470] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8286.690362] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8286.695982] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8290.408055] Lustre: server umount lustre-MDT0000 complete [ 8294.498135] LustreError: 297899:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782233521 with bad export cookie 3807062552910422461 [ 8294.503883] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8294.516498] LustreError: 297899:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8294.765847] Lustre: server umount lustre-MDT0001 complete [ 8303.714711] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8308.717140] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8313.454163] Lustre: server umount MGS complete [ 8324.846217] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8325.429331] LustreError: 302891:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8325.453469] LustreError: 302891:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8325.466246] LustreError: 302904:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8325.547126] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8330.724412] LustreError: 302892:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8330.867529] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8335.847089] LustreError: 302891:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8339.301716] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8339.779688] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8343.618350] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8350.181613] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8355.315349] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8361.636311] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8362.029989] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8367.549355] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8373.860163] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8400.864908] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8400.869790] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8400.888670] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8400.900699] Lustre: Skipped 1 previous similar message [ 8402.081541] Lustre: server umount lustre-OST0000 complete [ 8406.498175] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8406.514176] LustreError: Skipped 1 previous similar message [ 8406.520206] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8406.536528] Lustre: Skipped 1 previous similar message [ 8406.545369] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8406.554361] Lustre: Skipped 2 previous similar messages [ 8412.751987] Lustre: server umount lustre-MDT0000 complete [ 8417.060050] LustreError: 305728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782233643 with bad export cookie 3807062552910424309 [ 8417.075627] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8417.082251] LustreError: 305728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8417.714639] Lustre: server umount lustre-MDT0001 complete [ 8429.160407] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 8431.476378] Key type lgssc unregistered [ 8431.801495] LNet: 306836:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8431.813740] LNetError: 306836:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8431.842424] LNet: Removed LNI 192.168.203.102@tcp [ 8432.745961] Key type .llcrypt unregistered [ 8432.747712] Key type ._llcrypt unregistered [ 8453.037844] Key type ._llcrypt registered [ 8453.045622] Key type .llcrypt registered [ 8453.210780] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 8467.974606] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 8469.415873] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8469.485103] alg: No test for adler32 (adler32-zlib) [ 8470.576548] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 8470.798301] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 8472.487177] Key type lgssc registered [ 8473.704304] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8496.492638] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 8509.549992] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8509.573489] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8510.803254] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8510.833470] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8510.881755] Lustre: lustre-MDT0000: new disk, initializing [ 8510.949178] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8510.962245] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8514.674738] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8524.294596] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8524.541828] Lustre: lustre-OST0000: new disk, initializing [ 8524.545544] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8524.549397] Lustre: Skipped 1 previous similar message [ 8524.553612] Lustre: 310886:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8524.635449] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8530.725369] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 8534.691490] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8534.701140] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8534.738778] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9323.501041] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9323.528842] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9327.414996] Lustre: server umount lustre-MDT0000 complete [ 9331.701427] LustreError: 310074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782234558 with bad export cookie 15203584968941042595 [ 9331.704634] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9331.716704] LustreError: 310074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9331.901044] Lustre: server umount lustre-OST0000 complete [ 9356.011488] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [ 9365.059829] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 9396.796094] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9397.027267] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9397.046420] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9397.109456] Lustre: lustre-MDT0000: new disk, initializing [ 9397.164592] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9397.175195] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9400.908397] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9409.457610] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9409.573437] Lustre: 315224:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9409.642789] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9409.649697] Lustre: Skipped 1 previous similar message [ 9409.716812] Lustre: lustre-MDT0001: new disk, initializing [ 9409.785836] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9409.835650] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9409.847703] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9413.591346] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9422.157933] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9427.014981] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9432.860557] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9433.114329] Lustre: lustre-OST0000: new disk, initializing [ 9433.118920] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9433.125676] Lustre: 317193:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9433.195850] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9437.869543] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9440.286708] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9440.296420] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9440.455318] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9445.820475] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9449.386797] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9449.649049] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9453.283698] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9453.443716] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9455.584600] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9455.593736] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9455.608021] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9456.097631] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9461.287414] Lustre: server umount lustre-OST0000 complete [ 9466.337813] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9466.339312] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9466.352934] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9466.360721] Lustre: Skipped 2 previous similar messages [ 9466.369375] Lustre: Skipped 3 previous similar messages [ 9470.552687] Lustre: server umount lustre-MDT0000 complete [ 9471.460385] LustreError: 316414:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9471.487693] LustreError: 316414:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 9474.414337] LustreError: 315219:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782234701 with bad export cookie 15203584968943983414 [ 9474.415461] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9474.431551] LustreError: 315219:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9474.749478] Lustre: server umount lustre-MDT0001 complete [ 9478.186322] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 9479.735912] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 13:11:44 (1782234704) [ 9485.550684] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9485.905656] LustreError: 319504:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9485.979983] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9490.554577] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9491.436191] LustreError: 319505:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9495.520904] LustreError: 319504:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9497.751258] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9498.007401] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9501.812343] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9508.526101] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9513.564408] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9518.876651] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9519.169925] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9523.572346] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9530.141795] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9537.330992] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9537.496937] Lustre: lustre-OST0001: new disk, initializing [ 9537.500510] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 9537.508635] Lustre: 322339:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9537.624066] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9543.309905] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 9543.331148] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 9543.387169] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9543.446278] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9544.435832] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9544.450099] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 9545.507320] LustreError: 322696:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9545.519971] LustreError: 322696:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9547.569506] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9547.582537] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9551.722024] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9551.741186] LustreError: 322682:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 9552.774641] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9553.085385] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9558.239101] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9bcc088b4000.ost_server_uuid 50 [ 9559.615994] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9bcc088b4000.ost_server_uuid in FULL state after 0 sec [ 9559.980887] LustreError: 322696:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9559.989059] LustreError: 322696:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 16 previous similar messages [ 9564.536431] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9bcc088b4000.ost_server_uuid 50 [ 9565.723667] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9bcc088b4000.ost_server_uuid in FULL state after 0 sec [ 9567.219345] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 9582.563847] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9582.567171] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9582.574193] LustreError: Skipped 1 previous similar message [ 9582.576722] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9582.585821] Lustre: Skipped 1 previous similar message [ 9582.611371] Lustre: Skipped 1 previous similar message [ 9586.592715] Lustre: server umount lustre-OST0001 complete [ 9589.528150] LustreError: 321324:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.2@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9592.289940] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9592.301051] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9592.321191] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9592.336416] Lustre: Skipped 3 previous similar messages [ 9597.646845] Lustre: server umount lustre-OST0000 complete [ 9605.102498] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9605.107869] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9605.124415] Lustre: Skipped 2 previous similar messages [ 9605.144040] Lustre: Skipped 3 previous similar messages [ 9607.799806] Lustre: server umount lustre-MDT0000 complete [ 9610.212273] LustreError: 319505:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9610.221158] LustreError: 319505:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 9611.788825] LustreError: 319484:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782234838 with bad export cookie 15203584968943984296 [ 9611.813540] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9612.462761] Lustre: server umount lustre-MDT0001 complete [ 9624.873415] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 9628.608712] Key type lgssc unregistered [ 9628.837829] LNet: 325024:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9628.845192] LNetError: 325024:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9628.859987] LNet: Removed LNI 192.168.203.102@tcp [ 9629.684074] Key type .llcrypt unregistered [ 9629.689462] Key type ._llcrypt unregistered [ 9653.036228] Key type ._llcrypt registered [ 9653.038410] Key type .llcrypt registered [ 9653.135887] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 9654.364862] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9654.522972] alg: No test for adler32 (adler32-zlib) [ 9655.746338] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 9656.044351] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 9657.752330] Key type lgssc registered [ 9659.079628] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9667.024587] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9667.042459] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9668.617318] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9673.224789] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9678.818918] LustreError: 326447:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9678.841604] LustreError: 326447:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9680.868816] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9683.941573] LustreError: 326446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9687.598444] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9687.802372] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9692.472449] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9703.952895] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9704.217599] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9710.059917] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9712.426101] LustreError: 328127:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9713.494039] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 9716.675401] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9718.777536] LustreError: 328127:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9718.806552] LustreError: 328127:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9723.886433] LustreError: 328612:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9723.931139] LustreError: 328612:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9724.783809] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9724.962320] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9730.064794] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 9731.717861] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9739.853883] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 9747.016431] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 9747.225299] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9852.904791] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9852.913246] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9852.937538] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9852.945340] Lustre: Skipped 1 previous similar message [ 9858.042558] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9858.057204] Lustre: Skipped 1 previous similar message [ 9863.135144] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9863.147193] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9863.152807] Lustre: Skipped 1 previous similar message [ 9863.316187] Lustre: server umount lustre-OST0001 complete [ 9868.260180] LustreError: 328865:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9868.281303] LustreError: 328865:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9871.329312] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9871.332372] LustreError: Skipped 1 previous similar message [ 9871.345539] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9871.361592] Lustre: Skipped 1 previous similar message [ 9871.366589] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9872.355791] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9872.375377] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9876.119340] Lustre: server umount lustre-OST0000 complete [ 9882.594035] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9882.606761] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9882.620752] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9882.628641] Lustre: Skipped 3 previous similar messages [ 9886.779357] Lustre: server umount lustre-MDT0000 complete [ 9888.737953] LustreError: 327371:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9888.752118] LustreError: 327371:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9890.441944] LustreError: 326427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782235117 with bad export cookie 14124029263539967756 [ 9890.451635] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9890.456896] LustreError: 326427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9890.844795] Lustre: server umount lustre-MDT0001 complete [ 9901.669495] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [ 9904.538398] Key type lgssc unregistered [ 9904.858946] LNet: 331391:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9904.868294] LNetError: 331391:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9904.889228] LNet: Removed LNI 192.168.203.102@tcp [ 9905.978660] Key type .llcrypt unregistered [ 9905.980518] Key type ._llcrypt unregistered [ 9953.687975] Key type ._llcrypt registered [ 9953.691879] Key type .llcrypt registered [ 9953.865725] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [ 9955.462757] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9955.512381] alg: No test for adler32 (adler32-zlib) [ 9956.824872] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [ 9957.116267] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [ 9958.871276] Key type lgssc registered [ 9960.366327] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9970.513472] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9970.548908] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9972.121053] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9976.691074] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9981.417257] LustreError: 333684:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9981.443493] LustreError: 333684:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9985.021032] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9985.456402] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9990.146854] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [ 9993.279654] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10000.547027] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10001.056451] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10007.922883] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10010.285742] LustreError: 335171:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10015.719608] LustreError: 335174:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10016.288304] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10016.545458] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10017.610225] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [10017.623322] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [10023.143882] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10033.324873] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10044.833732] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [10057.185993] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10057.190981] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10057.204739] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10058.730289] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10058.742484] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10058.764993] Lustre: Skipped 2 previous similar messages [10061.474199] Lustre: server umount lustre-MDT0000 complete [10063.845658] LustreError: 333680:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10063.867806] LustreError: 333680:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [10065.205611] LustreError: 336696:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782235291 with bad export cookie 14920367323733969684 [10065.217337] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10065.222310] LustreError: 336696:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10065.502160] Lustre: server umount lustre-MDT0001 complete [10079.701274] Lustre: server umount lustre-OST0000 complete [10092.785679] Lustre: server umount lustre-OST0001 complete [10112.073595] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [10124.966428] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10125.476702] LustreError: 338952:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10125.595942] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10130.784559] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10136.042532] LustreError: 338953:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10136.057597] LustreError: 338953:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10141.907344] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10142.450439] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10149.394579] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10152.424889] Lustre: 340094:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10159.713308] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10160.585077] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10167.746254] LustreError: 340448:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10167.811210] LustreError: 340448:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10169.108634] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10170.888077] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10179.756287] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10185.249697] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10188.715734] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10197.206720] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10201.941306] Lustre: 341964:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10209.248606] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10209.265488] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10209.291024] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10209.297603] Lustre: Skipped 3 previous similar messages [10212.451831] Lustre: server umount lustre-MDT0000 complete [10215.918777] LustreError: 338948:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10215.946438] LustreError: 338948:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [10216.130588] LustreError: 338932:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782235442 with bad export cookie 14920367323733971385 [10216.136076] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10216.146417] LustreError: 338932:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10216.575887] Lustre: server umount lustre-MDT0001 complete [10230.445419] Lustre: server umount lustre-OST0000 complete [10244.821578] Lustre: server umount lustre-OST0001 complete [10248.772437] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10250.376948] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10252.410328] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 13:24:36 (1782235476) [10276.392524] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [10286.307868] loop0: detected capacity change from 0 to 1099511627776 [10286.855764] SGI XFS with ACLs, security attributes, quota, no debug enabled [10286.860604] *** VALIDATE xfs *** [10286.871700] XFS (loop0): Mounting V5 Filesystem [10286.895429] XFS (loop0): Ending clean mount [10288.127235] loop1: detected capacity change from 0 to 18691697672192 [10401.821142] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [10411.636647] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [10443.880781] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10444.251305] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10444.298635] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10444.388526] Lustre: lustre-MDT0000: new disk, initializing [10444.451264] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10444.454962] Lustre: Skipped 1 previous similar message [10444.470366] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10448.605852] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10458.766750] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10459.004599] Lustre: 347103:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10459.055707] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10459.059833] Lustre: Skipped 1 previous similar message [10459.180739] Lustre: lustre-MDT0001: new disk, initializing [10459.333902] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10459.357806] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10464.250470] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10474.300953] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10479.504408] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10486.332956] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10486.680069] Lustre: lustre-OST0000: new disk, initializing [10486.686202] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10486.697846] Lustre: 349072:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10488.068099] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10488.087205] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10488.144448] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10493.097881] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10503.197528] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10508.102696] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10508.410753] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10514.655834] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10514.894689] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10519.009363] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10519.012893] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10519.021348] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10519.021356] Lustre: Skipped 4 previous similar messages [10519.077039] Lustre: Skipped 4 previous similar messages [10524.136359] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10524.149077] Lustre: Skipped 2 previous similar messages [10531.296223] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10531.541312] Lustre: server umount lustre-OST0000 complete [10536.416206] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10536.429949] LustreError: Skipped 1 previous similar message [10536.441255] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10536.457375] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10536.464600] Lustre: Skipped 2 previous similar messages [10541.772880] Lustre: server umount lustre-MDT0000 complete [10544.637717] LustreError: 347116:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10544.669226] LustreError: 347116:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10545.793178] LustreError: 347098:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782235772 with bad export cookie 14920367323733972939 [10545.794649] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10545.813132] LustreError: 347098:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10546.059822] Lustre: server umount lustre-MDT0001 complete [10553.765505] XFS (loop0): Unmounting Filesystem [10558.380604] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 13:29:42 (1782235782) [10565.538866] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10566.262596] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10566.269041] Lustre: Skipped 2 previous similar messages [10570.520730] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10578.600260] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10583.238531] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10591.657678] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10596.898151] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10602.908668] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10609.333059] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10616.080618] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10624.996485] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10625.006230] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10625.018185] Lustre: Skipped 1 previous similar message [10625.024067] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10625.034557] Lustre: Skipped 2 previous similar messages [10630.883791] Lustre: server umount lustre-OST0000 complete [10635.232851] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10640.840462] Lustre: server umount lustre-MDT0000 complete [10643.832789] LustreError: 351614:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782235870 with bad export cookie 14920367323733973821 [10643.838317] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10643.849725] LustreError: 351614:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10644.139308] Lustre: server umount lustre-MDT0001 complete [10652.879580] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [10655.730873] Key type lgssc unregistered [10655.990283] LNet: 355262:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10656.000396] LNetError: 355262:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [10656.011921] LNet: Removed LNI 192.168.203.102@tcp [10656.787153] Key type .llcrypt unregistered [10656.789127] Key type ._llcrypt unregistered [10682.187472] Key type ._llcrypt registered [10682.191522] Key type .llcrypt registered [10682.303508] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [10683.426774] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10683.720889] alg: No test for adler32 (adler32-zlib) [10684.928677] Lustre: Lustre: Build Version: 2.17.54_83_g330a3f4 [10685.249568] LNet: Added LNI 192.168.203.102@tcp [8/256/0/180] [10686.991630] Key type lgssc registered [10688.356936] Lustre: Echo OBD driver; http://www.lustre.org/ [10697.502462] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10697.563258] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10698.990810] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10702.969762] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10708.450914] LustreError: 356835:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10708.468362] LustreError: 356835:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10711.764270] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10712.112367] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10716.212832] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10724.113931] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10730.933116] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10739.119284] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10739.525593] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10746.450298] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10754.118498] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10766.115483] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.2@tcp (stopping) [10767.331094] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10767.363500] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10769.677934] Lustre: server umount lustre-MDT0001 complete [10771.220855] LustreError: 356830:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.2@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10772.463807] LustreError: 356836:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10772.490520] LustreError: 356836:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10776.337330] LustreError: 356831:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.2@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10779.766285] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10779.922317] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10779.931789] Lustre: Found index 1 for lustre-MDT0001, updating log [10779.998983] Lustre: 356824:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10780.402416] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10785.289789] LustreError: 360256:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10785.304610] LustreError: 360256:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10785.311727] LustreError: 356827:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10785.392567] LustreError: 360263:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.102@tcp: cfg command failed: rc = -17 [10785.413058] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [10785.413058] [10785.797650] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10785.811035] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10796.899489] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.2@tcp (stopping) [10796.914840] Lustre: Skipped 1 previous similar message [10801.128180] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10801.159421] Lustre: Skipped 1 previous similar message [10801.163544] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10801.171120] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10801.193962] Lustre: Skipped 1 previous similar message [10802.673185] Lustre: server umount lustre-MDT0001 complete [10806.242499] LustreError: 356830:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10806.269796] LustreError: 356830:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [10814.131966] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10814.245295] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10814.251205] Lustre: Found index 1 for lustre-MDT0001, updating log [10814.302734] Lustre: 356824:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10814.603180] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10819.240274] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [10820.102838] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10820.115754] LustreError: 361394:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10820.125708] LustreError: 361394:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10820.133734] LustreError: 356827:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10820.145398] LustreError: 356827:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10820.245962] LustreError: 361405:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [10820.254640] LustreError: 361405:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [10820.265113] LustreError: 361405:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.102@tcp: cfg command failed: rc = -17 [10820.280566] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.102@tcp [10820.280566] [11124.527312] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.2@tcp (stopping) [11124.532678] Lustre: Skipped 1 previous similar message [11125.217685] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11125.236249] Lustre: Skipped 1 previous similar message [11130.540892] Lustre: server umount lustre-MDT0001 complete [11134.744126] LustreError: 358675:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.2@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11134.766888] LustreError: 358675:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [11142.169384] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11142.304275] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11142.312642] Lustre: Found index 1 for lustre-MDT0001, updating log [11142.335568] Lustre: 356824:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11142.738585] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [11147.797957] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11148.483654] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [11150.852584] LustreError: 370017:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11150.867412] LustreError: 370017:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11150.884717] LustreError: 356827:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11150.892765] LustreError: 356827:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11150.982958] LustreError: 370027:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [11151.016647] LustreError: 370027:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.102@tcp: cfg command failed: rc = -114 [11151.030721] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [11151.030721] [11475.427993] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11475.432068] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11475.434421] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11475.434435] Lustre: Skipped 5 previous similar messages [11475.445573] Lustre: Skipped 2 previous similar messages [11476.945273] Lustre: server umount lustre-MDT0000 complete [11480.548492] LustreError: 356832:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11480.588632] LustreError: 356832:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [11481.495676] LustreError: 360035:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782236708 with bad export cookie 11044055065425759175 [11481.501773] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11481.515872] LustreError: 360035:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11485.664661] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11485.682926] Lustre: Skipped 1 previous similar message [11488.033461] Lustre: server umount lustre-MDT0001 complete [11492.279647] Lustre: server umount lustre-OST0000 complete [11502.230272] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [11513.699697] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [11554.824882] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 13:46:18 (1782236778) [11561.327977] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11561.572944] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11561.603911] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11561.704424] Lustre: lustre-MDT0000: new disk, initializing [11561.780264] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11561.806519] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11565.925602] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [11575.988666] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11576.105122] Lustre: 380870:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11576.146552] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11576.150422] Lustre: Skipped 1 previous similar message [11576.203441] Lustre: lustre-MDT0001: new disk, initializing [11576.277259] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11576.314562] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11576.338046] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11580.277508] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [11589.011498] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11594.668324] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11601.581108] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11601.870804] Lustre: lustre-OST0000: new disk, initializing [11601.873835] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11601.879233] Lustre: 382836:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11601.952370] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11608.371709] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug -1 all [11612.212232] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11612.221151] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11612.330439] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11617.443876] Lustre: DEBUG MARKER: oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11625.965097] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [11625.977528] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11625.989108] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11625.992198] Lustre: Skipped 4 previous similar messages [11627.010858] Lustre: server umount lustre-MDT0000 complete [11628.003221] LustreError: 380881:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11628.020189] LustreError: 380881:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [11630.906389] LustreError: 380861:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782236857 with bad export cookie 11044055065425761128 [11630.909853] LustreError: MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11630.924865] LustreError: 380861:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11630.963059] LustreError: 381674:0:(osp_object.c:629:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [11631.279986] Lustre: server umount lustre-MDT0001 complete [11644.599976] Lustre: server umount lustre-OST0000 complete [11671.323913] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing set_hostid [11680.393713] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local [11711.621605] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 11454 sec ========= 13:48:55 (1782236935) [11713.278811] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 13:48:57 (1782236937) === [11717.005830] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 13:49:01 (1782236941) === [11759.072182] Lustre: DEBUG MARKER: oleg302-server.virtnet: executing unload_modules_local [11762.843801] Key type lgssc unregistered [11763.214282] LNet: 389201:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11763.237742] LNetError: 389201:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [11763.258902] LNet: Removed LNI 192.168.203.102@tcp [11764.159679] Key type .llcrypt unregistered [11764.163374] Key type ._llcrypt unregistered