[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 495300652 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.002385] x2apic enabled [ 0.003007] Switched APIC routing to physical x2apic. [ 0.004013] kvm-guest: setup PV IPIs [ 0.007279] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008022] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009023] pid_max: default: 32768 minimum: 301 [ 0.010127] LSM: Security Framework initializing [ 0.011057] Yama: becoming mindful. [ 0.012041] SELinux: Initializing. [ 0.013108] *** VALIDATE selinux *** [ 0.021709] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026117] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028052] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029110] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031118] *** VALIDATE tmpfs *** [ 0.032499] *** VALIDATE proc *** [ 0.033298] *** VALIDATE cgroup *** [ 0.034022] *** VALIDATE cgroup2 *** [ 0.035293] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.036197] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.037011] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.038032] Spectre V2 : User space: Vulnerable [ 0.039011] Speculative Store Bypass: Vulnerable [ 0.041813] debug: unmapping init [mem 0xffffffff9da59000-0xffffffff9da60fff] [ 0.043170] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.044716] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.045029] ... version: 2 [ 0.046014] ... bit width: 48 [ 0.047012] ... generic registers: 4 [ 0.048012] ... value mask: 0000ffffffffffff [ 0.049014] ... max period: 00007fffffffffff [ 0.050017] ... fixed-purpose events: 3 [ 0.051015] ... event mask: 000000070000000f [ 0.052354] rcu: Hierarchical SRCU implementation. [ 0.054492] smp: Bringing up secondary CPUs ... [ 0.055584] x86: Booting SMP configuration: [ 0.056044] .... node #0, CPUs: #1 #2 #3 [ 0.059472] smp: Brought up 1 node, 4 CPUs [ 0.061015] smpboot: Max logical packages: 1 [ 0.062020] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.132141] node 0 deferred pages initialised in 68ms [ 0.136101] devtmpfs: initialized [ 0.138289] x86/mm: Memory block size: 128MB [ 0.141000] gcov: version magic: 0x41383552 [ 0.145021] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.146078] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.147360] pinctrl core: initialized pinctrl subsystem [ 0.149240] [ 0.149952] ************************************************************* [ 0.153012] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.155014] ** ** [ 0.157008] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.159009] ** ** [ 0.161016] ** This means that this kernel is built to expose internal ** [ 0.163016] ** IOMMU data structures, which may compromise security on ** [ 0.165015] ** your system. ** [ 0.167014] ** ** [ 0.170016] ** If you see this message and you are not debugging the ** [ 0.172016] ** kernel, report this immediately to your vendor! ** [ 0.174030] ** ** [ 0.177018] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.179012] ************************************************************* [ 0.182667] NET: Registered protocol family 16 [ 0.185490] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.188085] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.190052] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.193114] cpuidle: using governor menu [ 0.194744] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.197571] PCI: Using configuration type 1 for base access [ 0.199151] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.209096] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.211050] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.214201] cryptd: max_cpu_qlen set to 1000 [ 0.216255] ACPI: Added _OSI(Module Device) [ 0.218014] ACPI: Added _OSI(Processor Device) [ 0.219010] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.220014] ACPI: Added _OSI(Processor Aggregator Device) [ 0.224897] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.230478] ACPI: Interpreter enabled [ 0.232065] ACPI: PM: (supports S0 S3 S4 S5) [ 0.233012] ACPI: Using IOAPIC for interrupt routing [ 0.235134] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.239419] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.248547] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.251050] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.254026] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.259085] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.264706] acpiphp: Slot [2] registered [ 0.266171] acpiphp: Slot [5] registered [ 0.268153] acpiphp: Slot [6] registered [ 0.269135] acpiphp: Slot [7] registered [ 0.271134] acpiphp: Slot [8] registered [ 0.272114] acpiphp: Slot [9] registered [ 0.274119] acpiphp: Slot [10] registered [ 0.276108] acpiphp: Slot [3] registered [ 0.278131] acpiphp: Slot [4] registered [ 0.279106] acpiphp: Slot [11] registered [ 0.281115] acpiphp: Slot [12] registered [ 0.283113] acpiphp: Slot [13] registered [ 0.284658] acpiphp: Slot [14] registered [ 0.287115] acpiphp: Slot [15] registered [ 0.288131] acpiphp: Slot [16] registered [ 0.290113] acpiphp: Slot [17] registered [ 0.292125] acpiphp: Slot [18] registered [ 0.295232] acpiphp: Slot [19] registered [ 0.297134] acpiphp: Slot [20] registered [ 0.298139] acpiphp: Slot [21] registered [ 0.300120] acpiphp: Slot [22] registered [ 0.302119] acpiphp: Slot [23] registered [ 0.303085] acpiphp: Slot [24] registered [ 0.304096] acpiphp: Slot [25] registered [ 0.306123] acpiphp: Slot [26] registered [ 0.308132] acpiphp: Slot [27] registered [ 0.309128] acpiphp: Slot [28] registered [ 0.311082] acpiphp: Slot [29] registered [ 0.312078] acpiphp: Slot [30] registered [ 0.313064] acpiphp: Slot [31] registered [ 0.314053] PCI host bridge to bus 0000:00 [ 0.316052] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.318027] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.321024] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.323020] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.327026] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.330021] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.332209] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.335227] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.339417] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.350883] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.356066] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.359021] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.362020] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.366019] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.368359] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.372897] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.375039] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.377848] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.382017] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.397943] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.403924] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.410691] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.415016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.422016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.443017] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.453410] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.459015] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.465015] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.482018] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.492753] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.498014] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.506017] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.527022] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.539312] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.546018] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.560023] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.579022] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.590000] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.596016] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.601017] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.617035] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.627349] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.634024] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.642023] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.660028] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.672000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.676475] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.679443] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.682465] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.685305] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.692044] iommu: Default domain type: Passthrough [ 0.693535] SCSI subsystem initialized [ 0.694000] ACPI: bus type USB registered [ 0.697226] usbcore: registered new interface driver usbfs [ 0.700132] usbcore: registered new interface driver hub [ 0.702107] usbcore: registered new device driver usb [ 0.704201] pps_core: LinuxPPS API ver. 1 registered [ 0.706017] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.709097] PTP clock support registered [ 0.712129] EDAC MC: Ver: 3.0.0 [ 0.714210] PCI: Using ACPI for IRQ routing [ 0.718166] NetLabel: Initializing [ 0.719012] NetLabel: domain hash size = 128 [ 0.721017] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.723136] NetLabel: unlabeled traffic allowed by default [ 0.726180] vgaarb: loaded [ 0.729325] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.731027] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.736373] clocksource: Switched to clocksource kvm-clock [ 0.844435] VFS: Disk quotas dquot_6.6.0 [ 0.845924] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.848557] *** VALIDATE ramfs *** [ 0.849739] *** VALIDATE hugetlbfs *** [ 0.851425] pnp: PnP ACPI init [ 0.853789] pnp: PnP ACPI: found 6 devices [ 0.872421] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.875599] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.877674] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.879666] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.881679] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.884094] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.887075] NET: Registered protocol family 2 [ 0.889697] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.893922] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.897964] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.903834] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.907798] TCP: Hash tables configured (established 65536 bind 65536) [ 0.911499] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.915748] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.920847] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.926663] NET: Registered protocol family 1 [ 0.931901] RPC: Registered named UNIX socket transport module. [ 0.934573] RPC: Registered udp transport module. [ 0.936625] RPC: Registered tcp transport module. [ 0.938449] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.940735] NET: Registered protocol family 44 [ 0.942921] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.945543] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.947555] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.949954] PCI: CLS 0 bytes, default 64 [ 0.953063] Unpacking initramfs... [ 2.392706] debug: unmapping init [mem 0xffff91a6fcc54000-0xffff91a6fffbffff] [ 2.397245] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.399786] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.403338] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.907753] Initialise system trusted keyrings [ 2.910204] Key type blacklist registered [ 2.912575] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.923910] zbud: loaded [ 2.927673] *** VALIDATE nfs *** [ 2.929469] *** VALIDATE nfs4 *** [ 2.931408] pstore: using deflate compression [ 2.936307] Platform Keyring initialized [ 3.047854] NET: Registered protocol family 38 [ 3.050443] Key type asymmetric registered [ 3.052673] Asymmetric key parser 'x509' registered [ 3.054922] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.059241] io scheduler mq-deadline registered [ 3.061114] io scheduler kyber registered [ 3.063280] io scheduler bfq registered [ 3.066435] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.069693] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.073320] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.076907] ACPI: Power Button [PWRF] [ 3.084291] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.091754] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.107172] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.115319] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.135889] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.164963] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.193472] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.199402] Non-volatile memory driver v1.3 [ 3.201239] Linux agpgart interface v0.103 [ 3.234658] virtio_blk virtio1: [vda] 133936 512-byte logical blocks (68.6 MB/65.4 MiB) [ 3.238130] vda: detected capacity change from 0 to 68575232 [ 3.254302] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.257748] vdb: detected capacity change from 0 to 1073741824 [ 3.275462] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.277858] vdc: detected capacity change from 0 to 2621440000 [ 3.295315] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.298656] vdd: detected capacity change from 0 to 2621440000 [ 3.318049] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.321731] vde: detected capacity change from 0 to 4294967296 [ 3.337624] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.341172] vdf: detected capacity change from 0 to 4294967296 [ 3.348578] libphy: Fixed MDIO Bus: probed [ 3.355470] usbcore: registered new interface driver usbserial_generic [ 3.358341] usbserial: USB Serial support registered for generic [ 3.360761] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.365336] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.367293] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.370051] mousedev: PS/2 mouse device common for all mice [ 3.373140] rtc_cmos 00:05: RTC can wake from S4 [ 3.376868] rtc_cmos 00:05: registered as rtc0 [ 3.378475] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.378492] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.385224] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.386728] intel_pstate: CPU model not supported [ 3.391776] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.396198] hid: raw HID events driver (C) Jiri Kosina [ 3.398961] usbcore: registered new interface driver usbhid [ 3.401443] usbhid: USB HID core driver [ 3.403162] drop_monitor: Initializing network drop monitor service [ 3.405662] Initializing XFRM netlink socket [ 3.407810] NET: Registered protocol family 10 [ 3.411357] Segment Routing with IPv6 [ 3.412919] NET: Registered protocol family 17 [ 3.416070] mpls_gso: MPLS GSO support [ 3.421670] RAS: Correctable Errors collector initialized. [ 3.424338] AVX version of gcm_enc/dec engaged. [ 3.426042] AES CTR mode by8 optimization enabled [ 3.501868] sched_clock: Marking stable (3501834535, 0)->(4391286247, -889451712) [ 3.507239] registered taskstats version 1 [ 3.509197] Loading compiled-in X.509 certificates [ 3.510806] zswap: loaded using pool lzo/zbud [ 3.537407] Key type big_key registered [ 3.549559] Key type encrypted registered [ 3.551474] ima: No TPM chip found, activating TPM-bypass! [ 3.554209] ima: Allocated hash algorithm: sha1 [ 3.556895] ima: No architecture policies found [ 3.559120] evm: Initialising EVM extended attributes: [ 3.561428] evm: security.selinux [ 3.562479] evm: security.ima [ 3.563806] evm: security.capability [ 3.565322] evm: HMAC attrs: 0x1 [ 3.569260] rtc_cmos 00:05: setting system clock to 2026-04-09 19:54:19 UTC (1775764459) [ 3.575902] debug: unmapping init [mem 0xffffffff9ea03000-0xffffffff9ebfffff] [ 3.579901] debug: unmapping init [mem 0xffffffff9d782000-0xffffffff9da58fff] [ 3.588074] Write protecting the kernel read-only data: 28672k [ 3.592208] debug: unmapping init [mem 0xffffffff9be03000-0xffffffff9bffffff] [ 3.594752] debug: unmapping init [mem 0xffffffff9c714000-0xffffffff9c7fffff] [ 3.634678] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.643563] systemd[1]: Detected virtualization kvm. [ 3.646183] systemd[1]: Detected architecture x86-64. [ 3.648388] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.674297] systemd[1]: No hostname configured. [ 3.676649] systemd[1]: Set hostname to . [ 3.679399] random: systemd: uninitialized urandom read (16 bytes read) [ 3.681647] systemd[1]: Initializing machine ID from random generator. [ 3.819923] random: systemd: uninitialized urandom read (16 bytes read) [ 3.822656] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 3.829132] random: systemd: uninitialized urandom read (16 bytes read) [ 3.831294] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 3.836756] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Swap. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Timers. Starting Apply Kernel Variables... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Slices. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Sockets. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.438305] device-mapper: uevent: version 1.0.3 [ 4.441251] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 5.109923] virtio_net virtio0 ens2: renamed from eth0 [ 5.139707] random: fast init done [ 5.167242] scsi host0: ata_piix [ 5.182644] scsi host1: ata_piix [ 5.186082] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.190629] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 8.899632] dracut-initqueue[588]: RTNETLINK answers: File exists [ 10.071420] random: crng init done [ 10.073309] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.455491] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Slices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 12.094137] printk: systemd: 26 output lines suppressed due to ratelimiting [ 13.032211] SELinux: Disabled at runtime. [ 13.172634] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 13.204598] systemd[1]: Detected virtualization kvm. [ 13.207734] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 15.059595] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.065136] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 15.075931] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 15.085871] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 15.095046] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 15.124768] systemd[1]: Starting Journal Service... Starting Journal Service... [ 15.162653] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Mounting Kernel Debug File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-getty.slice. Starting Apply Kernel Variables... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Switch Root. Mounting Huge Pages File System... [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on udev Control Socket. Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Created slic[ 15.600101] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS e system-sshd\x2dkeygen.slice. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Initrd File Systems. Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting udev Coldplug all Devices... [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Mounted /mnt. [ 17.029096] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 18.251414] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 18.264049] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 19.044070] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 19.130984] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…-only root support (9s / no limit)[ 24.647902] Key type dns_resolver registered [ *** ] A start job is running for Configur…only root support (10s / no limit)[ 25.559035] NFS: Registering the id_resolver key type [ 25.563605] Key type id_resolver registered [ 25.568057] Key type id_legacy registered [ ***] A start job is running for Configur…only root support (10s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Mark the need to relabel after reboot. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Restore /run/initramfs on shutdown... Starting Network Manager... Starting Login Service... [ OK ] Started dnf makecache --timer. [ OK ] Started irqbalance daemon. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... [ OK ] Started Login Service. Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg421-server login: [ 52.392224] hrtimer: interrupt took 4213329 ns [ 88.531150] libcfs: loading out-of-tree module taints kernel. [ 88.627261] Key type ._llcrypt registered [ 88.632384] Key type .llcrypt registered [ 88.849288] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 108.945712] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 110.950796] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 110.963622] alg: No test for adler32 (adler32-zlib) [ 112.571448] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 113.776169] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 115.674640] Key type lgssc registered [ 118.038992] Lustre: Echo OBD driver; http://www.lustre.org/ [ 140.302832] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 184.883953] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 199.852488] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 199.893425] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 201.223929] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 201.274534] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 201.410411] Lustre: lustre-MDT0000: new disk, initializing [ 201.530729] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 201.555232] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 205.898362] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 219.890477] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 220.049881] Lustre: 6509:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 220.130456] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 220.143653] Lustre: Skipped 1 previous similar message [ 220.266946] Lustre: lustre-MDT0001: new disk, initializing [ 220.460534] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 220.542405] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 220.565431] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 225.725554] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 230.740240] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 243.359889] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 243.790813] Lustre: lustre-OST0000: new disk, initializing [ 243.794251] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 243.933960] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 244.417141] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 244.434762] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 244.596573] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 251.513175] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 268.279442] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 268.500409] Lustre: lustre-OST0001: new disk, initializing [ 268.504917] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 268.593134] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 276.672203] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 277.067091] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 277.074713] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 277.146646] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 289.899257] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 298.018869] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 309.538358] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing check_logdir /tmp/testlogs/ [ 314.904995] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing yml_node [ 319.632391] Lustre: DEBUG MARKER: Client: 2.17.51.76 [ 322.357510] Lustre: DEBUG MARKER: MDS: 2.17.51.76 [ 325.229239] Lustre: DEBUG MARKER: OSS: 2.17.51.76 [ 327.234662] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Apr 9 15:59:41 EDT 2026 [ 346.664604] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 348.601430] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 369.130532] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 369.141164] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 369.156612] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 371.696851] Lustre: server umount lustre-MDT0000 complete [ 375.637880] LustreError: 7439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775764831 with bad export cookie 9908557914636121073 [ 375.638725] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 375.656345] LustreError: 7439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 379.873391] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 379.876176] LustreError: 6514:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 379.882983] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 379.882993] Lustre: Skipped 3 previous similar messages [ 379.894107] Lustre: Skipped 4 previous similar messages [ 379.939130] LustreError: 6514:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 380.910623] LustreError: 10027:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 380.911755] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 380.936795] Lustre: Skipped 2 previous similar messages [ 382.083488] Lustre: server umount lustre-MDT0001 complete [ 385.951703] Lustre: server umount lustre-OST0000 complete [ 390.795595] Lustre: server umount lustre-OST0001 complete [ 397.279938] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 408.975500] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 447.920808] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 448.185809] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 448.235982] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 448.325840] Lustre: lustre-MDT0000: new disk, initializing [ 448.401182] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 448.423939] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 452.900476] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 463.798364] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 463.927176] Lustre: 14998:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 463.976797] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 463.981050] Lustre: Skipped 1 previous similar message [ 464.069197] Lustre: lustre-MDT0001: new disk, initializing [ 464.170913] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 464.206114] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 464.219940] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 468.764942] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 478.574484] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 483.144539] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 493.482964] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 494.104650] Lustre: lustre-OST0000: new disk, initializing [ 494.110138] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 494.177170] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 495.594365] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 495.605913] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 495.734467] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 500.960978] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 508.490611] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 513.789980] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 514.063418] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 519.476261] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 519.649975] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 526.306072] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 526.320948] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 526.324397] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 526.349874] Lustre: Skipped 1 previous similar message [ 528.305206] Lustre: server umount lustre-OST0000 complete [ 536.032898] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 536.036892] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 536.043480] Lustre: Skipped 1 previous similar message [ 536.046454] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 539.593055] Lustre: server umount lustre-MDT0000 complete [ 541.665244] LustreError: 15010:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 541.682358] LustreError: 15010:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 543.600243] LustreError: 14992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775764999 with bad export cookie 9908557914636122606 [ 543.609934] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 543.611975] LustreError: 14992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 543.994124] Lustre: server umount lustre-MDT0001 complete [ 549.495834] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 16:03:24 (1775765004) [ 557.120778] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 557.683050] LustreError: 18861:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 557.761461] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 562.178918] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 563.180264] LustreError: 18862:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 571.971736] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 576.750957] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 582.954493] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 586.345850] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 593.734020] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 599.990098] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 605.948622] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 609.411902] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 617.955300] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 617.965166] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 617.980274] Lustre: Skipped 3 previous similar messages [ 617.993232] Lustre: Skipped 3 previous similar messages [ 622.096977] Lustre: server umount lustre-MDT0000 complete [ 623.075607] LustreError: 18858:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 623.094751] LustreError: 18858:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 625.990716] LustreError: 18842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765081 with bad export cookie 9908557914636123488 [ 625.997647] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 626.009128] LustreError: 18842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 626.559599] Lustre: server umount lustre-MDT0001 complete [ 641.208275] Lustre: server umount lustre-OST0000 complete [ 664.754596] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 674.698288] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 675.190053] LustreError: 22891:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 675.278585] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 675.286056] Lustre: Skipped 2 previous similar messages [ 680.302312] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 688.806445] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 694.021297] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 697.246806] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 704.440374] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 711.087436] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 720.286309] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 720.447344] Lustre: lustre-OST0001: new disk, initializing [ 720.452488] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 722.209361] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 722.222554] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 722.330187] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 726.462941] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 735.735759] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 739.454655] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 760.801410] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 760.823410] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 760.841520] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 763.465366] Lustre: server umount lustre-MDT0000 complete [ 766.440351] LustreError: 22886:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 766.459283] LustreError: 22886:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 767.517556] LustreError: 22871:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765223 with bad export cookie 9908557914636124335 [ 767.535708] LustreError: 22871:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 767.538063] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 767.866602] Lustre: server umount lustre-MDT0001 complete [ 781.308153] Lustre: server umount lustre-OST0000 complete [ 796.121680] Lustre: server umount lustre-OST0001 complete [ 815.132599] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 825.059879] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 825.563874] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 825.575978] Lustre: Skipped 3 previous similar messages [ 829.870977] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 830.945621] LustreError: 28150:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 830.964124] LustreError: 28150:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 837.533444] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 842.633254] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 845.293881] Lustre: 29263:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 851.313969] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 858.057664] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 867.199040] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 873.275971] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 881.490479] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 885.676176] Lustre: 31115:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 899.557753] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 899.558199] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 899.562295] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 899.562302] Lustre: Skipped 4 previous similar messages [ 899.573978] Lustre: Skipped 5 previous similar messages [ 903.093309] Lustre: server umount lustre-MDT0000 complete [ 906.748935] LustreError: 28129:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765362 with bad export cookie 9908557914636125630 [ 906.757838] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 906.764729] LustreError: 28129:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 907.026437] Lustre: server umount lustre-MDT0001 complete [ 920.920318] Lustre: server umount lustre-OST0000 complete [ 933.432884] Lustre: server umount lustre-OST0001 complete [ 942.779514] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 16:09:57 (1775765397) [ 971.519531] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 983.270277] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 983.847330] LustreError: 33903:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 983.869467] LustreError: 33903:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 988.132853] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 997.451058] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1002.314314] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1005.080185] Lustre: 35018:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1011.686494] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1018.022864] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1026.183257] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1033.006366] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1040.718897] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1043.924735] Lustre: 36872:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1054.178075] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1054.186331] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1054.197705] Lustre: Skipped 1 previous similar message [ 1054.208272] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1054.221322] Lustre: Skipped 3 previous similar messages [ 1059.712720] Lustre: server umount lustre-MDT0000 complete [ 1063.101452] LustreError: 33883:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765519 with bad export cookie 9908557914636126729 [ 1063.107849] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1063.121347] LustreError: 33883:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1063.447555] Lustre: server umount lustre-MDT0001 complete [ 1077.237045] Lustre: server umount lustre-OST0000 complete [ 1080.296174] Lustre: 3659:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775765520/real 1775765520] req@ffff91a648799f80 x1862024109054208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775765536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1081.948295] Lustre: server umount lustre-OST0001 complete [ 1091.465858] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 16:12:26 (1775765546) [ 1109.080410] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 1120.600446] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1121.095833] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1121.100569] Lustre: Skipped 7 previous similar messages [ 1126.055498] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1134.613616] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1140.026168] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1143.815200] Lustre: 40113:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1152.832717] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1161.017925] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1170.481319] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1177.360444] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1184.944521] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1188.559592] Lustre: 41967:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1194.495178] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1194.501719] Lustre: Skipped 1 previous similar message [ 1200.768759] Lustre: lustre-MDT0000: Not available for connect from 192.168.204.21@tcp (stopping) [ 1200.774211] Lustre: Skipped 3 previous similar messages [ 1201.646734] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1201.656149] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1201.665265] Lustre: Skipped 6 previous similar messages [ 1203.521925] Lustre: server umount lustre-MDT0000 complete [ 1207.050319] LustreError: 39732:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765662 with bad export cookie 9908557914636127842 [ 1207.061434] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1207.066441] LustreError: 39732:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1213.526951] Lustre: server umount lustre-MDT0001 complete [ 1221.773354] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1236.207669] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1242.930784] LustreError: 42884:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1242.947818] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1242.952861] LustreError: 42884:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 31 previous similar messages [ 1243.431375] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1248.270551] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1249.270874] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1249.279708] Lustre: Skipped 1 previous similar message [ 1254.365396] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1256.132121] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1260.352431] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1262.024181] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1269.218325] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1274.407841] Lustre: server umount lustre-MDT0000 complete [ 1279.498343] LustreError: 42023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765735 with bad export cookie 9908557914636129032 [ 1279.509319] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1279.514028] LustreError: 42023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1279.859328] Lustre: server umount lustre-MDT0001 complete [ 1294.781680] Lustre: server umount lustre-OST0000 complete [ 1295.845124] Lustre: 3657:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775765735/real 1775765735] req@ffff91a6488b0700 x1862024109146880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775765751 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1298.446641] Lustre: server umount lustre-OST0001 complete [ 1307.426252] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 16:16:02 (1775765762) [ 1323.802533] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 1335.344297] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1340.418934] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1350.467740] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1356.650726] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1359.756787] Lustre: 47465:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1366.877347] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1373.340764] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1382.898143] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1389.856552] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1398.262633] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1408.656727] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1422.817719] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1422.831440] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1422.853849] Lustre: Skipped 8 previous similar messages [ 1427.995917] Lustre: server umount lustre-MDT0000 complete [ 1432.153479] LustreError: 49439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775765888 with bad export cookie 9908557914636129823 [ 1432.157834] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1432.168832] LustreError: 49439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1432.720965] Lustre: server umount lustre-MDT0001 complete [ 1447.021822] Lustre: server umount lustre-OST0000 complete [ 1450.975356] Lustre: 3659:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775765890/real 1775765890] req@ffff91a647beed80 x1862024109211264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775765906 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1451.833558] Lustre: server umount lustre-OST0001 complete [ 1463.735521] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 16:18:38 (1775765918) [ 1466.812077] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1468.942196] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 16:18:43 (1775765923) [ 1481.155274] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 1492.196678] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 1518.677512] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1518.967752] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1519.063156] Lustre: lustre-MDT0000: new disk, initializing [ 1519.178833] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1523.652334] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1532.260040] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1541.415976] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1541.828157] Lustre: lustre-OST0000: new disk, initializing [ 1541.832085] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1541.841059] Lustre: Skipped 1 previous similar message [ 1543.350867] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1543.367612] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1543.436235] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1550.971447] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1562.662660] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1565.384112] Lustre: DEBUG MARKER: create test files [ 1609.269385] Lustre: server umount lustre-OST0000 complete [ 1622.755855] Lustre: server umount lustre-MDT0000 complete [ 1639.118422] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 1642.870810] Key type lgssc unregistered [ 1643.238084] LNet: 54880:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1643.255927] LNetError: 54880:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1643.300779] LNet: Removed LNI 192.168.204.121@tcp [ 1644.346559] Key type .llcrypt unregistered [ 1644.355691] Key type ._llcrypt unregistered [ 1682.961708] Key type ._llcrypt registered [ 1682.966476] Key type .llcrypt registered [ 1683.169419] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 1683.976763] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1684.172122] alg: No test for adler32 (adler32-zlib) [ 1685.225617] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 1685.641829] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 1687.319747] Key type lgssc registered [ 1689.088895] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1697.479462] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1697.500129] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1698.944082] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1703.797389] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1709.697108] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1717.214086] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1717.560639] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1723.697262] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1723.782161] Lustre: 57487:0:(osd_internal.h:1446:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1723.787284] Lustre: 57487:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1723.794512] Lustre: 57487:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1723.798865] Lustre: 57487:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1723.803956] Lustre: 57487:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1723.809598] Lustre: 57487:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1724.152378] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1732.414075] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1741.494178] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1749.867477] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1758.492864] Lustre: server umount lustre-OST0000 complete [ 1774.283660] Lustre: server umount lustre-MDT0000 complete [ 1786.220601] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 1789.066955] Key type lgssc unregistered [ 1789.366554] LNet: 58972:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1789.374073] LNetError: 58972:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1789.403681] LNet: Removed LNI 192.168.204.121@tcp [ 1790.334644] Key type .llcrypt unregistered [ 1790.339615] Key type ._llcrypt unregistered [ 1825.760661] Key type ._llcrypt registered [ 1825.762189] Key type .llcrypt registered [ 1825.980064] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 1827.666135] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1827.762415] alg: No test for adler32 (adler32-zlib) [ 1828.815849] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 1829.083605] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 1830.837057] Key type lgssc registered [ 1832.113609] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1841.013625] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1841.052707] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1842.784597] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1848.241908] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1854.393154] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1863.220516] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1863.622358] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1867.707638] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1867.838373] Lustre: 61680:0:(osd_internal.h:1446:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 514 < left 544, rollback = 9 [ 1867.856435] Lustre: 61680:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/1, destroy: 0/0/0 [ 1867.870039] Lustre: 61680:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1867.883489] Lustre: 61680:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1867.898415] Lustre: 61680:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1867.904418] Lustre: 61680:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1871.098378] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 1877.847895] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1884.434504] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1898.464530] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1898.467628] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1898.492905] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1900.902231] Lustre: server umount lustre-OST0000 complete [ 1905.548717] Lustre: server umount lustre-MDT0000 complete [ 1917.399283] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 1920.086364] Key type lgssc unregistered [ 1920.415503] LNet: 63109:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1920.432080] LNetError: 63109:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1920.452456] LNet: Removed LNI 192.168.204.121@tcp [ 1921.444660] Key type .llcrypt unregistered [ 1921.448251] Key type ._llcrypt unregistered [ 1942.924653] Key type ._llcrypt registered [ 1942.928134] Key type .llcrypt registered [ 1943.038666] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 1960.366868] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 1961.437415] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1961.501663] alg: No test for adler32 (adler32-zlib) [ 1962.544414] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 1962.770314] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 1964.487870] Key type lgssc registered [ 1965.848329] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2007.769560] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2007.824122] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2009.256375] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2009.318346] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2009.450679] Lustre: lustre-MDT0000: new disk, initializing [ 2009.612333] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2009.667315] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2015.088188] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2029.166496] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2029.372034] Lustre: 66231:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2029.468567] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2029.476770] Lustre: Skipped 1 previous similar message [ 2029.596295] Lustre: lustre-MDT0001: new disk, initializing [ 2029.740664] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2029.817917] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2029.835933] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2036.740845] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2047.780880] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2052.330518] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2060.828679] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2061.223756] Lustre: lustre-OST0000: new disk, initializing [ 2061.238313] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2061.354570] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2068.626781] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2068.645477] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2068.815078] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2069.420725] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2077.353307] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2082.204361] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2082.437829] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2087.694722] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2087.933871] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2094.566517] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2094.569568] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2094.587159] LustreError: Skipped 1 previous similar message [ 2094.593673] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2094.617666] Lustre: Skipped 1 previous similar message [ 2094.650154] Lustre: Skipped 1 previous similar message [ 2096.589748] Lustre: server umount lustre-OST0000 complete [ 2101.728520] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2101.732897] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2101.758495] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2104.801225] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2104.802231] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2107.599429] Lustre: server umount lustre-MDT0000 complete [ 2111.720239] LustreError: 66224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775766567 with bad export cookie 17410678691419107888 [ 2111.734835] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2111.740628] LustreError: 66224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2112.202295] Lustre: server umount lustre-MDT0001 complete [ 2124.174309] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 16:29:38 (1775766578) [ 2136.900925] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 2189.025719] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 2201.330403] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 2253.672112] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2254.131093] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2254.206847] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2254.360810] Lustre: lustre-MDT0000: new disk, initializing [ 2254.534728] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2254.567803] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2259.385677] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2272.488984] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2272.603311] Lustre: 73805:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2272.659569] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2272.664624] Lustre: Skipped 1 previous similar message [ 2272.680578] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 2272.690521] Lustre: Skipped 1 previous similar message [ 2272.748839] Lustre: lustre-MDT0001: new disk, initializing [ 2272.840932] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2272.877475] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2272.894546] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2278.248828] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2287.969130] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2292.432412] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2301.459711] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2301.952647] Lustre: lustre-OST0000: new disk, initializing [ 2301.967210] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2302.086159] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2310.109684] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2310.815747] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2310.834302] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2310.992585] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2319.963418] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2325.341686] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2325.695633] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2330.647042] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2330.909459] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2336.748539] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2336.767229] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2336.776805] Lustre: Skipped 1 previous similar message [ 2336.803842] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2339.675653] Lustre: server umount lustre-OST0000 complete [ 2344.417069] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2344.433454] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2346.977439] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2346.987752] Lustre: Skipped 3 previous similar messages [ 2350.690668] Lustre: server umount lustre-MDT0000 complete [ 2352.103646] LustreError: 73814:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2352.148703] LustreError: 73814:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2356.194105] LustreError: 73815:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2356.203200] LustreError: 73815:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2356.700830] LustreError: 73796:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775766812 with bad export cookie 17410678691419108770 [ 2356.734981] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2356.737164] LustreError: 73796:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2358.382864] Lustre: server umount lustre-MDT0001 complete [ 2374.425443] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 16:33:48 (1775766828) [ 2384.464564] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2385.317320] LustreError: 77813:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2385.496258] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2390.499415] LustreError: 77814:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2392.171563] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2395.615969] LustreError: 77813:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2405.327226] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2411.907703] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2420.418779] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2425.117234] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2433.762435] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2434.270953] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2434.286775] Lustre: Skipped 1 previous similar message [ 2441.973248] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2449.936957] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2454.362376] Lustre: 80150:0:(genops.c:1793:obd_export_evict_by_uuid()) MGS: evicting 5f3f15f4-8ef1-4b8e-8124-3bebe8e7f267 at adminstrative request [ 2456.035390] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2456.048594] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2465.253572] Lustre: MGS: Client 5f3f15f4-8ef1-4b8e-8124-3bebe8e7f267 (at 0@lo) reconnecting [ 2465.273746] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xf19f28062c7fb914 to 0xf19f28062c7fbbad [ 2465.293650] Lustre: MGC192.168.204.121@tcp: Connection restored to 0@lo (at 0@lo) [ 2495.489232] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2495.769269] Lustre: lustre-OST0001: new disk, initializing [ 2495.793193] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2501.288340] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2501.316601] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2501.442140] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2503.461639] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2512.053823] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2516.962359] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2516.971509] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2516.991829] Lustre: Skipped 2 previous similar messages [ 2516.993764] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2517.022296] Lustre: Skipped 1 previous similar message [ 2530.271260] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2530.498537] Lustre: server umount lustre-OST0001 complete [ 2532.336607] LustreError: 79410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2532.353816] LustreError: 79410:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2537.460072] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2537.486195] Lustre: Skipped 1 previous similar message [ 2543.690698] Lustre: server umount lustre-OST0000 complete [ 2552.802172] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2552.816430] Lustre: Skipped 9 previous similar messages [ 2556.231733] Lustre: server umount lustre-MDT0000 complete [ 2557.922691] LustreError: 77832:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2557.947754] LustreError: 77832:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 2561.315927] LustreError: 77795:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775767017 with bad export cookie 17410678691419110317 [ 2561.326306] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2561.335949] LustreError: 77795:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2562.168940] Lustre: server umount lustre-MDT0001 complete [ 2574.655159] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 16:37:08 (1775767028) [ 2577.167307] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2579.703838] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 16:37:13 (1775767033) [ 2582.013956] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2584.577492] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 16:37:18 (1775767038) [ 2587.252360] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2589.955764] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 16:37:24 (1775767044) [ 2592.168308] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2594.342530] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 16:37:28 (1775767048) [ 2596.735298] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2604.867190] loop: module loaded [ 2604.889130] loop0: detected capacity change from 0 to 4294967296 [ 2604.931254] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2607.231766] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2611.862339] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2616.908987] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2651.706801] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2651.775884] LustreError: 84551:0:(obd_config.c:843:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2651.785336] LustreError: 84551:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2651.792447] LustreError: 84551:0:(tgt_mount.c:2513:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2651.801915] LustreError: 84551:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2677.539317] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 2690.408556] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 2736.271979] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2736.728543] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2736.784751] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2736.931982] Lustre: lustre-MDT0000: new disk, initializing [ 2737.033951] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2737.042727] Lustre: Skipped 1 previous similar message [ 2737.065492] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2742.127486] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2754.969090] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2755.166829] Lustre: 87385:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2755.566302] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2761.340375] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2772.824492] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2778.455915] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2788.089377] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2796.403095] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2797.167815] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2797.334217] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2807.048431] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2814.191410] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2814.503341] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2821.635447] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2821.957483] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2828.278508] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2828.279517] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2828.289407] LustreError: Skipped 1 previous similar message [ 2828.290717] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2828.347013] Lustre: Skipped 3 previous similar messages [ 2830.602559] Lustre: server umount lustre-OST0000 complete [ 2841.440783] Lustre: server umount lustre-MDT0000 complete [ 2843.621788] LustreError: 87393:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2843.651159] LustreError: 87393:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2846.465774] LustreError: 88165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775767302 with bad export cookie 17410678691419110940 [ 2846.466208] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2846.476804] LustreError: 88165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2847.214884] Lustre: server umount lustre-MDT0001 complete [ 2857.056737] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 16:41:51 (1775767311) [ 2865.470483] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2866.446174] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2866.451150] Lustre: Skipped 2 previous similar messages [ 2872.106408] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2881.684905] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2887.443810] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2894.342546] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2899.617435] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2908.396057] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2916.327517] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2923.587902] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2929.081679] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2929.398816] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2935.356813] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2935.766866] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2944.464590] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2944.624736] Lustre: lustre-OST0001: new disk, initializing [ 2944.627047] Lustre: Skipped 2 previous similar messages [ 2944.631903] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2944.642558] Lustre: Skipped 3 previous similar messages [ 2950.892558] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 2954.879823] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2954.885666] Lustre: Skipped 2 previous similar messages [ 2954.888537] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2955.071887] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2959.097490] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2964.062856] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2964.282535] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2970.047326] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2970.251600] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2992.338445] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3027.515217] Lustre: Failing over lustre-MDT0000 [ 3028.387685] Lustre: server umount lustre-MDT0000 complete [ 3030.222087] LustreError: 91391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3030.255823] LustreError: 91391:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3030.498290] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3030.510339] LustreError: Skipped 2 previous similar messages [ 3030.518992] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3030.548931] Lustre: Skipped 2 previous similar messages [ 3047.393476] Lustre: 64455:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775767487/real 1775767487] req@00000000288e738f x1862026047814016/t0(0) o400->MGC192.168.204.121@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1775767503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3047.441448] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3053.806377] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 3053.812145] LDISKFS-fs (dm-0): recovery complete [ 3053.829228] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3057.645255] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xf19f28062c80862f [ 3057.674112] Lustre: MGC192.168.204.121@tcp: Connection restored to 0@lo (at 0@lo) [ 3058.221468] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3061.858182] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3061.880151] Lustre: 92477:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3063.278928] Lustre: 91396:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3063.300559] Lustre: 91396:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 1 previous similar message [ 3063.325172] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 3063.453994] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3063.530549] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3063.793551] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3064.115263] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3064.153540] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 3064.519070] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3064.528862] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 3064.546307] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3064.553622] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 7 previous similar messages [ 3065.219857] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3065.244718] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 2 previous similar messages [ 3065.602826] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3065.618981] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 2 previous similar messages [ 3066.609309] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3066.629563] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 5 previous similar messages [ 3067.280546] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3067.297243] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 5 previous similar messages [ 3067.623178] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3067.630364] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 5 previous similar messages [ 3070.834182] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3070.851115] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 12 previous similar messages [ 3071.506729] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3071.539282] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 3071.879129] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3071.888680] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 3078.896849] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3078.921197] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 24 previous similar messages [ 3079.586605] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3079.610784] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 24 previous similar messages [ 3079.944656] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3079.963087] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 24 previous similar messages [ 3094.944327] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3094.989961] Lustre: 97113:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 49 previous similar messages [ 3095.665206] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3095.683457] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 49 previous similar messages [ 3095.999244] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3096.015099] LustreError: 97113:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 49 previous similar messages [ 3121.271317] Lustre: 97113:0:(ldlm_lib.c:2377:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 3121.289734] Lustre: 97113:0:(ldlm_lib.c:2387:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3121.318877] Lustre: 97113:0:(genops.c:1620:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 3844bd96-7f1e-4b79-a802-7b32819f88c8@192.168.204.21@tcp [ 3121.347532] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3121.361677] Lustre: 97113:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@0000000055fa7172 x1862026030814848/t0(8589934776) o35->3844bd96-7f1e-4b79-a802-7b32819f88c8@192.168.204.21@tcp:37/0 lens 392/0 e 0 to 0 dl 1775767587 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 3121.420779] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 3121.464264] Lustre: lustre-MDT0000: Denying connection for new client 3844bd96-7f1e-4b79-a802-7b32819f88c8 (at 192.168.204.21@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 3121.497775] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 3121.557540] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 3121.557783] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3121.611238] Lustre: Skipped 2 previous similar messages [ 3121.652263] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 3121.663390] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 3141.602076] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3141.617587] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3141.624839] Lustre: Skipped 4 previous similar messages [ 3147.766812] Lustre: server umount lustre-OST0000 complete [ 3160.552797] LustreError: 92993:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3160.573240] LustreError: 92993:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 43 previous similar messages [ 3166.175117] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3166.347035] Lustre: server umount lustre-OST0001 complete [ 3172.839576] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3172.860226] Lustre: Skipped 7 previous similar messages [ 3177.580096] Lustre: server umount lustre-MDT0000 complete [ 3182.861864] LustreError: 94397:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775767638 with bad export cookie 17410678691419162159 [ 3182.864323] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3182.877982] LustreError: 94397:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3183.485737] Lustre: server umount lustre-MDT0001 complete [ 3193.509207] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 16:47:28 (1775767648) [ 3201.982500] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3201.992199] Lustre: *** cfs_fail_loc=197, val=0*** [ 3217.695528] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3222.816423] LustreError: 99086:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.121@tcp: failed processing log, type 4: rc = -110 [ 3227.983319] Lustre: *** cfs_fail_loc=197, val=0*** [ 3228.001292] Lustre: Skipped 65 previous similar messages [ 3248.543544] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3248.553297] Lustre: Skipped 4 previous similar messages [ 3255.210954] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3262.383644] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3264.914518] Lustre: server umount lustre-OST0000 complete [ 3277.173569] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 16:48:51 (1775767731) [ 3300.998537] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3307.158096] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3316.025532] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3320.305435] LustreError: 100627:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3320.324763] LustreError: 100627:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3320.342699] LustreError: 100627:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 19, retries 0, failed: rc = -5 [ 3320.629770] Lustre: server umount lustre-MDT0000 complete [ 3358.037897] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 3369.349269] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 3410.280311] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3410.605816] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3410.644424] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3410.743626] Lustre: lustre-MDT0000: new disk, initializing [ 3410.874716] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3416.124744] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3427.185897] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3427.284515] Lustre: 104655:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3427.665709] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3432.514515] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3440.856363] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3445.138519] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3452.254158] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3459.381511] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3459.980461] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3468.755940] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3473.702438] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3473.931489] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3479.807853] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3480.229955] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3485.159052] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3485.159916] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3485.175113] Lustre: Skipped 2 previous similar messages [ 3485.186826] Lustre: Skipped 15 previous similar messages [ 3488.460450] Lustre: server umount lustre-OST0000 complete [ 3494.368701] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3494.377332] LustreError: Skipped 4 previous similar messages [ 3498.891239] Lustre: server umount lustre-MDT0000 complete [ 3500.517115] LustreError: 105872:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3500.534710] LustreError: 105872:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 3503.163612] LustreError: 104646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775767959 with bad export cookie 17410678691419172813 [ 3503.168659] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3503.185027] LustreError: 104646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3503.664519] Lustre: server umount lustre-MDT0001 complete [ 3513.430737] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 16:52:48 (1775767968) [ 3521.609785] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 3524.596219] Key type lgssc unregistered [ 3524.961518] LNet: 108722:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3524.971872] LNetError: 108722:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3524.986213] LNet: Removed LNI 192.168.204.121@tcp [ 3526.031833] Key type .llcrypt unregistered [ 3526.034942] Key type ._llcrypt unregistered [ 3545.296493] Key type ._llcrypt registered [ 3545.299656] Key type .llcrypt registered [ 3545.407476] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 3561.897746] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 3562.953660] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3563.139183] alg: No test for adler32 (adler32-zlib) [ 3564.341598] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 3564.663410] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 3566.416334] Key type lgssc registered [ 3568.071918] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3614.605877] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3614.628099] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3616.019329] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3616.090965] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3616.260203] Lustre: lustre-MDT0000: new disk, initializing [ 3616.412237] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3616.454718] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3621.423113] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3633.284868] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3633.742096] Lustre: lustre-OST0000: new disk, initializing [ 3633.751537] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3633.766508] Lustre: Skipped 1 previous similar message [ 3633.853522] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3640.428147] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3643.053826] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3643.068877] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3643.110441] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3651.935046] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3652.057408] Lustre: lustre-OST0001: new disk, initializing [ 3652.060598] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3652.131146] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3658.987581] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3662.030777] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3662.044203] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3662.102203] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3672.546151] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3672.575862] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3672.589614] Lustre: Skipped 1 previous similar message [ 3676.059968] Lustre: server umount lustre-MDT0000 complete [ 3683.333124] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3687.931644] LustreError: 112049:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775768143 with bad export cookie 13847322969533855916 [ 3687.932383] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3687.944289] LustreError: 112049:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3688.119437] Lustre: server umount lustre-OST0000 complete [ 3692.238811] Lustre: server umount lustre-OST0001 complete [ 3701.902933] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 16:55:56 (1775768156) [ 3711.564836] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 3737.462370] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 16:56:31 (1775768191) [ 3780.812345] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 3790.368705] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 3828.564775] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3828.777727] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3828.806986] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3828.864753] Lustre: lustre-MDT0000: new disk, initializing [ 3828.923855] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3828.937261] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3833.866532] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3845.461551] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3845.601927] Lustre: 120386:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3845.668190] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3845.679885] Lustre: Skipped 1 previous similar message [ 3845.804823] Lustre: lustre-MDT0001: new disk, initializing [ 3845.914710] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3845.943327] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3845.951966] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3850.670653] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3857.985756] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3862.835135] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3870.801249] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3871.215858] Lustre: lustre-OST0000: new disk, initializing [ 3871.226348] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3871.334496] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3877.886319] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3878.987504] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3878.993427] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3879.156351] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3885.625248] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3890.557150] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3890.864748] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3895.383966] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3895.703965] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3899.896292] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3899.898786] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3899.909178] Lustre: Skipped 1 previous similar message [ 3899.910804] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3899.929386] Lustre: Skipped 1 previous similar message [ 3904.715415] Lustre: server umount lustre-OST0000 complete [ 3912.675514] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3912.681070] LustreError: Skipped 1 previous similar message [ 3912.683451] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3912.692035] Lustre: Skipped 1 previous similar message [ 3912.695914] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3915.232406] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3915.235725] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3915.251669] Lustre: Skipped 1 previous similar message [ 3916.444845] Lustre: server umount lustre-MDT0000 complete [ 3920.026766] LustreError: 120380:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775768375 with bad export cookie 13847322969533857141 [ 3920.045493] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3920.053116] LustreError: 120380:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3920.518488] Lustre: server umount lustre-MDT0001 complete [ 3929.380296] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 16:59:43 (1775768383) [ 3936.943851] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3937.399477] LustreError: 124394:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3937.415319] LustreError: 124394:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3937.458531] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3942.425651] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3942.882380] LustreError: 124395:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3948.010614] LustreError: 124394:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3950.708231] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3955.233745] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3961.649965] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3965.411579] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3972.128782] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3972.430812] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3972.437229] Lustre: Skipped 1 previous similar message [ 3977.776521] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 3983.326509] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3988.041728] Lustre: *** cfs_fail_loc=159, val=0*** [ 4004.506335] Lustre: lustre-MDT0000: Client 83f989be-6928-4a1f-8d77-8b076c6ebb40 (at 192.168.204.21@tcp) reconnecting [ 4006.492235] Lustre: *** cfs_fail_loc=159, val=0*** [ 4006.495531] Lustre: Skipped 5 previous similar messages [ 4021.886704] Lustre: lustre-MDT0000: Client 83f989be-6928-4a1f-8d77-8b076c6ebb40 (at 192.168.204.21@tcp) reconnecting [ 4042.214318] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4042.227529] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4042.247239] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4045.966387] Lustre: server umount lustre-OST0000 complete [ 4053.472345] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4053.490083] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4053.498988] Lustre: Skipped 1 previous similar message [ 4053.505101] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4053.511473] Lustre: Skipped 2 previous similar messages [ 4055.937441] Lustre: server umount lustre-MDT0000 complete [ 4059.335356] LustreError: 124374:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775768515 with bad export cookie 13847322969533858023 [ 4059.364828] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4059.596835] Lustre: server umount lustre-MDT0001 complete [ 4071.207786] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 4074.584501] Key type lgssc unregistered [ 4074.908987] LNet: 127829:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4074.916083] LNetError: 127829:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4074.930774] LNet: Removed LNI 192.168.204.121@tcp [ 4075.669231] Key type .llcrypt unregistered [ 4075.675611] Key type ._llcrypt unregistered [ 4109.128523] Key type ._llcrypt registered [ 4109.131491] Key type .llcrypt registered [ 4109.230210] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 4109.902021] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4109.949028] alg: No test for adler32 (adler32-zlib) [ 4110.919833] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 4111.100344] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 4112.768851] Key type lgssc registered [ 4113.645745] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4121.359092] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4121.390021] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4122.871842] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4127.647894] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4132.329525] LustreError: 129247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4132.337779] LustreError: 129247:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4133.895822] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4134.133604] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4136.645721] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4140.932278] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4144.728227] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4152.585193] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4152.922836] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4159.842089] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4166.148791] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4167.281332] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 4176.830675] Lustre: *** cfs_fail_loc=159, val=0*** [ 4193.426369] Lustre: lustre-MDT0000: Client 0778cbeb-64ba-45d0-a4b1-0e287643954d (at 192.168.204.21@tcp) reconnecting [ 4195.849461] Lustre: *** cfs_fail_loc=159, val=0*** [ 4212.395681] Lustre: lustre-MDT0001: Client 0778cbeb-64ba-45d0-a4b1-0e287643954d (at 192.168.204.21@tcp) reconnecting [ 4213.989753] Lustre: *** cfs_fail_loc=159, val=0*** [ 4213.996056] Lustre: Skipped 3 previous similar messages [ 4230.291557] Lustre: lustre-MDT0001: Client 0778cbeb-64ba-45d0-a4b1-0e287643954d (at 192.168.204.21@tcp) reconnecting [ 4235.823830] Lustre: 131944:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4239.405088] Lustre: *** cfs_fail_loc=159, val=0*** [ 4239.412273] Lustre: Skipped 4 previous similar messages [ 4254.934235] Lustre: lustre-MDT0000: Client b868d5c5-0fb8-4d2a-9b6b-abff3e71bac3 (at 192.168.204.21@tcp) reconnecting [ 4256.957128] Lustre: *** cfs_fail_loc=159, val=0*** [ 4256.965542] Lustre: Skipped 13 previous similar messages [ 4273.310207] Lustre: lustre-MDT0000: Client b868d5c5-0fb8-4d2a-9b6b-abff3e71bac3 (at 192.168.204.21@tcp) reconnecting [ 4274.803422] Lustre: 132232:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4280.291371] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4280.313634] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4280.314904] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4280.358032] Lustre: Skipped 1 previous similar message [ 4285.420874] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4285.432029] Lustre: Skipped 2 previous similar messages [ 4286.376495] Lustre: server umount lustre-OST0000 complete [ 4290.535412] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4290.544159] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4290.549935] Lustre: Skipped 1 previous similar message [ 4295.673248] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4295.688818] Lustre: Skipped 1 previous similar message [ 4296.762641] Lustre: server umount lustre-MDT0000 complete [ 4300.227061] LustreError: 131724:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775768756 with bad export cookie 6237831316452987928 [ 4300.232828] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4300.240396] LustreError: 131724:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4300.657721] Lustre: server umount lustre-MDT0001 complete [ 4311.149675] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 4313.423363] Key type lgssc unregistered [ 4313.660820] LNet: 133268:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4313.671227] LNetError: 133268:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4313.689537] LNet: Removed LNI 192.168.204.121@tcp [ 4314.389957] Key type .llcrypt unregistered [ 4314.392447] Key type ._llcrypt unregistered [ 4340.753950] Key type ._llcrypt registered [ 4340.756634] Key type .llcrypt registered [ 4340.862878] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 4342.254491] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4342.295450] alg: No test for adler32 (adler32-zlib) [ 4343.333406] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 4343.625485] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 4345.319365] Key type lgssc registered [ 4346.642917] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4354.792899] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4354.816131] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4356.341380] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4361.136336] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4366.827757] LustreError: 134666:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4366.850483] LustreError: 134666:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4370.366567] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4370.750441] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4375.709678] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4382.228344] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4386.449932] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4393.665851] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4394.058400] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4396.094421] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4400.524946] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4401.198180] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4406.571928] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4413.946303] Lustre: 136916:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4418.003935] Lustre: 136964:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4419.991768] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4420.935427] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4426.462492] Lustre: 137111:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4427.756497] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4429.029094] Lustre: 137219:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4436.974740] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4436.978341] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4436.985404] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4436.997054] Lustre: Skipped 1 previous similar message [ 4437.015328] Lustre: Skipped 1 previous similar message [ 4439.753459] Lustre: server umount lustre-OST0000 complete [ 4447.201234] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4447.204036] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4447.212400] Lustre: Skipped 1 previous similar message [ 4447.221928] Lustre: Skipped 1 previous similar message [ 4449.268676] Lustre: server umount lustre-MDT0000 complete [ 4452.324445] LustreError: 134662:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4452.339495] LustreError: 134662:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4453.367402] LustreError: 134646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775768909 with bad export cookie 9997631279833440577 [ 4453.373219] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4453.382763] LustreError: 134646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4453.903634] Lustre: server umount lustre-MDT0001 complete [ 4464.617969] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 4467.129228] Key type lgssc unregistered [ 4467.406247] LNet: 138254:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4467.410571] LNetError: 138254:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4467.426188] LNet: Removed LNI 192.168.204.121@tcp [ 4468.299225] Key type .llcrypt unregistered [ 4468.301801] Key type ._llcrypt unregistered [ 4493.176315] Key type ._llcrypt registered [ 4493.178623] Key type .llcrypt registered [ 4493.270681] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 4494.542930] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4494.576441] alg: No test for adler32 (adler32-zlib) [ 4495.666473] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 4495.859625] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 4497.527181] Key type lgssc registered [ 4498.768130] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4506.436989] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4506.463656] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4507.851966] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4512.130853] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4517.352524] LustreError: 139652:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4517.385031] LustreError: 139652:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4521.828136] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4522.421676] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4527.102667] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4533.130835] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4537.176512] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4545.049034] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4545.371719] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4547.449518] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4551.738782] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4552.566805] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4557.004850] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4562.980960] Lustre: *** cfs_fail_loc=159, val=0*** [ 4579.485291] Lustre: lustre-MDT0000: Client cf912f07-c1e8-47e8-a193-431f735728a6 (at 192.168.204.21@tcp) reconnecting [ 4598.754075] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4598.760027] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4598.764395] LustreError: Skipped 1 previous similar message [ 4598.765578] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4598.795982] Lustre: Skipped 1 previous similar message [ 4602.372064] Lustre: server umount lustre-OST0000 complete [ 4608.997644] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4609.003292] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4609.010092] Lustre: Skipped 1 previous similar message [ 4609.018989] Lustre: Skipped 2 previous similar messages [ 4612.328140] Lustre: server umount lustre-MDT0000 complete [ 4614.113887] LustreError: 139653:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4614.143980] LustreError: 139653:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4616.272502] LustreError: 141930:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775769072 with bad export cookie 2600462033193661952 [ 4616.273130] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4616.293446] LustreError: 141930:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4616.602544] Lustre: server umount lustre-MDT0001 complete [ 4628.661631] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 4632.449370] Key type lgssc unregistered [ 4632.861832] LNet: 142968:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4632.889465] LNetError: 142968:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4632.906122] LNet: Removed LNI 192.168.204.121@tcp [ 4634.032962] Key type .llcrypt unregistered [ 4634.035172] Key type ._llcrypt unregistered [ 4661.228100] Key type ._llcrypt registered [ 4661.231909] Key type .llcrypt registered [ 4661.361686] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 4662.725108] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4662.957203] alg: No test for adler32 (adler32-zlib) [ 4664.017818] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 4664.331805] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 4665.999221] Key type lgssc registered [ 4667.330027] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4676.729422] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4676.741952] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4678.367637] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4683.168719] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4688.876375] LustreError: 144372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4688.909352] LustreError: 144372:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4693.497775] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4693.955496] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4699.067864] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4706.606138] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4712.502105] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4721.183400] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4721.548678] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4723.612319] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4728.398192] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4734.927341] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4739.004960] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4758.703818] Lustre: lustre-OST0000: evicting a1a77b06-49db-463d-bb1d-808d5a6fa4d9 (at 192.168.204.21@tcp) by administrative request [ 4758.714725] Lustre: Skipped 1 previous similar message [ 4788.204194] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4788.212608] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4788.219259] Lustre: Skipped 1 previous similar message [ 4788.236342] Lustre: Skipped 1 previous similar message [ 4793.318327] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4798.449468] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4798.462719] Lustre: Skipped 2 previous similar messages [ 4802.015633] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4802.317602] Lustre: server umount lustre-OST0000 complete [ 4806.626865] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4806.637918] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4806.653460] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4808.678330] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4812.982840] Lustre: server umount lustre-MDT0000 complete [ 4813.793816] LustreError: 144372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4813.815487] LustreError: 144372:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4817.556849] LustreError: 144351:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775769273 with bad export cookie 2735816316491143393 [ 4817.577222] LustreError: 144351:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4817.584988] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4817.912770] Lustre: server umount lustre-MDT0001 complete [ 4830.285725] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 4833.613425] Key type lgssc unregistered [ 4833.868478] LNet: 148091:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4833.876473] LNetError: 148091:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4833.910446] LNet: Removed LNI 192.168.204.121@tcp [ 4834.768113] Key type .llcrypt unregistered [ 4834.770879] Key type ._llcrypt unregistered [ 4918.225836] Key type ._llcrypt registered [ 4918.229692] Key type .llcrypt registered [ 4918.371896] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 4919.825414] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4919.859421] alg: No test for adler32 (adler32-zlib) [ 4921.119746] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 4921.408988] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 4923.149257] Key type lgssc registered [ 4924.698828] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4935.356432] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4935.403164] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4937.210739] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4942.309550] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4947.428687] LustreError: 150566:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4947.467936] LustreError: 150566:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4952.440630] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4952.545473] LustreError: 150565:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4952.934254] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4957.909463] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4964.252772] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4968.464935] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4976.100097] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4976.546935] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4977.607659] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4982.786344] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4984.018673] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 4991.379524] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5003.260091] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5003.266052] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5003.296974] LustreError: Skipped 1 previous similar message [ 5003.308666] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5007.898574] Lustre: server umount lustre-OST0000 complete [ 5013.477285] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5013.484034] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5013.502907] Lustre: Skipped 2 previous similar messages [ 5013.535728] Lustre: Skipped 2 previous similar messages [ 5018.593036] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5018.600256] Lustre: Skipped 1 previous similar message [ 5019.605107] Lustre: server umount lustre-MDT0000 complete [ 5023.208362] LustreError: 150546:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775769479 with bad export cookie 4090892069841039154 [ 5023.223389] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5023.232149] LustreError: 150546:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5023.559498] Lustre: server umount lustre-MDT0001 complete [ 5036.286879] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 5039.285733] Key type lgssc unregistered [ 5039.580587] LNet: 153756:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5039.599622] LNetError: 153756:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5039.613179] LNet: Removed LNI 192.168.204.121@tcp [ 5040.358862] Key type .llcrypt unregistered [ 5040.360685] Key type ._llcrypt unregistered [ 5067.073835] Key type ._llcrypt registered [ 5067.076232] Key type .llcrypt registered [ 5067.247717] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 5068.839249] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5068.925554] alg: No test for adler32 (adler32-zlib) [ 5070.002537] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 5070.256901] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 5071.871175] Key type lgssc registered [ 5073.384054] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5090.171936] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 17:19:04 (1775769544) [ 5106.325515] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 5116.890909] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 5155.278488] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5155.311516] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5156.542636] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5156.597643] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5156.699647] Lustre: lustre-MDT0000: new disk, initializing [ 5156.816224] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5156.842634] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5160.982164] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 5171.251835] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5171.365644] Lustre: 157971:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5171.422920] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5171.428856] Lustre: Skipped 1 previous similar message [ 5171.538546] Lustre: lustre-MDT0001: new disk, initializing [ 5171.630027] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5171.671806] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5171.689479] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5176.163562] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 5183.764319] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5187.740833] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5194.408956] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5194.653594] Lustre: lustre-OST0000: new disk, initializing [ 5194.657722] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5194.729672] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5200.076852] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 5200.972898] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5200.989204] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5201.123887] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5207.810559] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5221.857092] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5221.863351] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5221.869406] LustreError: Skipped 1 previous similar message [ 5221.877904] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5221.893314] Lustre: Skipped 1 previous similar message [ 5221.918120] Lustre: Skipped 1 previous similar message [ 5226.978207] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5226.987177] Lustre: Skipped 1 previous similar message [ 5231.074111] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5231.239770] Lustre: server umount lustre-OST0000 complete [ 5237.218763] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5237.256411] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5237.266469] Lustre: Skipped 1 previous similar message [ 5241.787702] Lustre: server umount lustre-MDT0000 complete [ 5247.140283] LustreError: 157962:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775769703 with bad export cookie 8819424748365380726 [ 5247.175929] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5247.561986] Lustre: server umount lustre-MDT0001 complete [ 5263.073911] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 5266.570708] Key type lgssc unregistered [ 5266.995691] LNet: 161489:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5267.009566] LNetError: 161489:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5267.034806] LNet: Removed LNI 192.168.204.121@tcp [ 5268.127764] Key type .llcrypt unregistered [ 5268.131600] Key type ._llcrypt unregistered [ 5293.793595] Key type ._llcrypt registered [ 5293.798651] Key type .llcrypt registered [ 5293.950291] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 5295.289116] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5295.451390] alg: No test for adler32 (adler32-zlib) [ 5296.533796] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 5296.802325] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 5298.463151] Key type lgssc registered [ 5299.457694] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5306.950505] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5306.975347] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5308.538716] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5312.638887] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 5318.126300] LustreError: 162887:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5318.164514] LustreError: 162887:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5322.343028] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5322.840250] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5328.847588] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 5334.824994] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5338.086262] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5351.961228] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5352.497971] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5353.541121] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5360.900134] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 5369.793395] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5379.375292] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5379.411669] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5379.436380] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5379.449668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.479783] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5381.367603] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5381.408068] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5381.710032] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5381.728452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.748149] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5384.653640] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5384.694174] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5384.712753] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5384.716502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.735023] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5386.784239] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5386.818540] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5386.826150] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5386.832650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5386.841051] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5388.403361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.193424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.701969] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5391.711326] Lustre: Skipped 2 previous similar messages [ 5391.725769] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5391.743483] Lustre: Skipped 2 previous similar messages [ 5391.749466] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5391.759160] Lustre: Skipped 2 previous similar messages [ 5391.763630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.781947] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5391.787360] Lustre: Skipped 2 previous similar messages [ 5393.230855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.099983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.722171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.145352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.320689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.517412] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5400.522862] Lustre: Skipped 5 previous similar messages [ 5400.557142] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5400.564693] Lustre: Skipped 5 previous similar messages [ 5400.572708] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5400.581880] Lustre: Skipped 5 previous similar messages [ 5400.587792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.595581] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5400.598554] Lustre: Skipped 5 previous similar messages [ 5401.419883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5402.609901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5403.759103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.065719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.242809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.438422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.682687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.659644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5410.682381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.652694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.781907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.065638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.350734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.421115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.324458] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5417.329477] Lustre: Skipped 14 previous similar messages [ 5417.341643] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5417.350969] Lustre: Skipped 14 previous similar messages [ 5417.354776] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5417.357327] Lustre: Skipped 14 previous similar messages [ 5417.361718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.374291] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5417.385564] Lustre: Skipped 14 previous similar messages [ 5418.303608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.375128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.462722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5421.463980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.550664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.541085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.629794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5425.438198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.369548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.268613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.254432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.167100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.322970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.248669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.303653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.327235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.167336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.163466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.229518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.155043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5438.312771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.519839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.525218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.631636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.516456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.450694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.358280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5445.279230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.272583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.207936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5448.543176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.445116] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5449.453310] Lustre: Skipped 31 previous similar messages [ 5449.473715] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5449.498285] Lustre: Skipped 31 previous similar messages [ 5449.512292] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5449.528810] Lustre: Skipped 31 previous similar messages [ 5449.534347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.554639] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5449.567179] Lustre: Skipped 31 previous similar messages [ 5450.647643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.666917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.675770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.725286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5454.751207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.848703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.970362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.081867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.909487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5459.761029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.679083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.595829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.554629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.670750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.604406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.643992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.596096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.722967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.634140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.452600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.329472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.114382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.948978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.994138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5473.886794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.777364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.782874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5476.781066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5477.879195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5479.045103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.020237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.022879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.853889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.731534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.681494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.666714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.446846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.446615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.259252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.241447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.224782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.188600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.223235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.122758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.928896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.894953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.749923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.839976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.975353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.216562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5499.333381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.185812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.123916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.881468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.823262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.814130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.699591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.576161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.444533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.306232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.307627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.334927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.164071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.082741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.991729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.891480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.795583] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5513.806418] Lustre: Skipped 66 previous similar messages [ 5513.818571] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5513.828454] Lustre: Skipped 66 previous similar messages [ 5513.832808] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5513.837531] Lustre: Skipped 66 previous similar messages [ 5513.841215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.850798] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5513.853848] Lustre: Skipped 66 previous similar messages [ 5514.811195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.767480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.787541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.784508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.770984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.684482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.719397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.680985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.996894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.101413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.952178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.025892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.013781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.133810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.374316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5530.528829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.704351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.742519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.848360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.070920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.364825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.684366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.878692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.972764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.952762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.025657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.048381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.048696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.141390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.198157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.198163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.223137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.252586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.318431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.317569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.437987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.433796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.513874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.570503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.664019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.608533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.680738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.874580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.790391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.926589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.841505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.950705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.022719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.184640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.109244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.106560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.114133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.041556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.851177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.992927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.881687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.767625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.689212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.605149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.659451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.727495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.779071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.662673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.726976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.557851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.737809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.882758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.983648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.069745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.090813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.200912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.308467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.140885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.278531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.302258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.284716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.234386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.272505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.300649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.319576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.200609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.179042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.084742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.220407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.415072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.262775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.358735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.320237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.428804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.461466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.434565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.448327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.459594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.518318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.502447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.308498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.323345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.090880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.975961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.739033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.835782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.702340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.656797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.618976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.677913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.705314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.909840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.751739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.828728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.675980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.747581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.720749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.760648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.772110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.645337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.620743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.730516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.808270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.811964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.676895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.605882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.538728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.409972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.407511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.274957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.219953] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5642.232233] Lustre: Skipped 125 previous similar messages [ 5642.253664] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5642.281558] Lustre: Skipped 125 previous similar messages [ 5642.285718] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5642.294556] Lustre: Skipped 125 previous similar messages [ 5642.299747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.324572] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5642.334929] Lustre: Skipped 125 previous similar messages [ 5643.330251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.431349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.584408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.522680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.362430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.475313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.245770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.293510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.326419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.543755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.590715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.907054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.988154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.119545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.270182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.505936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.639713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.824231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.988956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.074922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.172720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.279918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5667.351052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.456448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.883518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.190150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.374344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.576849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.945875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.893866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.425044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.661622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.673196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.629964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.821232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.038816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.087571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.296091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.262594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.113522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.239465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.481375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.332222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.610652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.712795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.754806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.093779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.331397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.311916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.484568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.460517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.443083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.424310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.503431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.631758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.658441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.744579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.836871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.119554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.148853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.743131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.001551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.095652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.056141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.366612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.855720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.147779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.962274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.517858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.462972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.260138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.739179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.879805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.089321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.710657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.209308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.648352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.942432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.465796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.427343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.779602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.088865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.440578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.791073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.232818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.184283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.397363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.513529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.704664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.938554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.238972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.473159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.608757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.752705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.015024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.197611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.207166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.304740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5758.447742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.532702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.538783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.627123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5762.791646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5763.943455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5765.057171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5765.999553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.068509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.035360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.053452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.030913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.126685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5772.246689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5773.229555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.370160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.515456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.352389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.361417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.330323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.539991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.583888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5781.712970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.000519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.216527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5785.276723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.473957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.634891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5788.866089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.047403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.144278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.468800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.740823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5795.153914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.373580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.683572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.857241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.180191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.548189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.734414] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5802.739309] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5802.770284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.081635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.260727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.549221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.767902] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5807.789184] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5807.810857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.208362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.553161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.839598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.944546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5814.669945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.848470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.242646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.732147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.851934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.203341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.418476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.555187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.721247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.783851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.888275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.924517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.856137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5829.795635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.752698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.614590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5832.667151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.647087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.711062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.584130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.533993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.644948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5838.824812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5840.000338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.215110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.287842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.563851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.512059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.563689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.659112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.709087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.797707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.733837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.782468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.136583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.128563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.171496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.155656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5856.168307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.499285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5858.470446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.510759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.634892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.708289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.841573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.037755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5865.252485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.546778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5867.965203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5869.527905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.845859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.052708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.297902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.459655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.624893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5876.537529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.797519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5878.755466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.881371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.004049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.061581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5883.427814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5884.376404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.593660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.694721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.749637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5888.742336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.765328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.805040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.718108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.694773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5893.600540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.564304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.465168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.664530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.008191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.167749] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5899.179617] Lustre: Skipped 222 previous similar messages [ 5899.198833] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5899.212303] Lustre: Skipped 222 previous similar messages [ 5899.217310] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5899.225931] Lustre: Skipped 222 previous similar messages [ 5899.230173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.261277] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5899.285285] Lustre: Skipped 222 previous similar messages [ 5900.416606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.470837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.516735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5903.548490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.528777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5905.590595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.703982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.712289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5908.788662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.836263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.901490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5911.730657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5912.752303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.805079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.997981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5916.388430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5917.381713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.646401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5919.736534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5920.657755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.722701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.825896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.948909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.081351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5926.159654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.183835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.054369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.202822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5930.291763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.251383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5932.544502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.600750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.550603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.592921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5936.674768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.753813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.863677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.913267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.845188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.723536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.728545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.667751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.607370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.744434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5946.810421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.959375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.810887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5949.786095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.788197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5951.836069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.838415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.674781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.604890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5955.793668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.798415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5957.948538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.186396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5960.253990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.261375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.237813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.381305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.401688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.425292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.602475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5967.624972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.714716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.774952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.835293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.896106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.842697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.839106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5974.730422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.981696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.148675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.384758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.365838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.354621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.441099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.473055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.516523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.445793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5985.431351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.347213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.314086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.179505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.111322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.150717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.087663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.034500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.986395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.083711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5995.365672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.421628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5997.416468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.673807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5999.634500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.737795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.960847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.039773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.087429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6005.324312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.095532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.256707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6008.377891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.748153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.700675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.787722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.826423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.941799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.046919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.016038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.913608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.938655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.019494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.158732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.093353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.077302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6023.205615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.282505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.268644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.386129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.453916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.625901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.780942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.018261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.994328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.043713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.241271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.347994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.595448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.495193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6038.421814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.197990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6040.310691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.329424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.234577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.208057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.259060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6045.239593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.242134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.279663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.275787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.245061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.321571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.507941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6052.500147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6053.395797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.293368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.336921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.269800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.376350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.247082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.362393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.351332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.661745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.739927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.976490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.052585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.153200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.225602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.211848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.255441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.316301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.252559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.456462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6073.460552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.664097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6075.838123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.015261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.351891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6079.633125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.954629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.175033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.430994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.653631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.636339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6086.757757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.970844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6089.047894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.113193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.159600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.120275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.130099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.089654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.967047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6095.956796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.913018] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6097.970214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.930579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.042557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.977083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.937726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.058841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6104.369176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.503511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.498043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.451499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.658219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.752810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.023511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.012391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6113.086408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.344203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.439818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6116.357320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.500249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.617462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.556381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.700823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.633141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.743182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.856374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.006653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.214983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.516227] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6127.535097] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6127.544254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6128.556084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.756582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.038046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6132.043264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.064672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6134.045306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6135.104477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6136.195036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6137.462495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6138.638827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6139.848765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.881592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.855361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6142.916688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.903939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6144.946954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6146.031914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6147.091178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.133949] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6148.140448] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6148.150485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.194814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6150.241787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.373539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.263911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6153.374366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.452476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.584953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6156.851144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6157.921064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.935986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.934469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6160.774915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6161.621535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.584157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.514649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6164.478924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.330657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.166376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.236506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6168.502430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.891209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.926981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6172.097444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.020682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.953389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6175.075464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.405775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.369830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6178.836489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6180.242318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6181.438397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6182.908942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6183.830470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6184.900857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.042715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6187.288867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.457108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6189.908973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.885622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6192.090652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6193.217646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6194.228618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6195.392885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6196.238572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6197.364322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6198.308514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.383838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6200.374899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6201.583397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6202.586398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6203.979484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6205.040274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6205.991547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.967619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6207.886507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.926434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6209.900650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.865875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.819130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6212.887870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6213.798224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6214.984319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6215.955525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6217.059900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6218.157568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6219.184696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.379325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6221.440418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6222.547071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6223.847969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6224.949852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.908897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6227.458964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.392310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6229.407423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6230.459452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6231.409380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.473460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6233.323273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6234.591779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6235.808935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6237.004384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.080888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.980779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6239.987556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.862736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6241.859306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.800087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6243.855912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.798982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6245.852482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6246.778036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6247.819384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6248.867473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6249.866243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6250.862632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6251.968904] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6251.981178] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6251.987666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6253.052774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6254.063985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6254.922348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.046327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.993828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6258.081378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.056665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.975701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6261.129774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6261.946361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6263.073431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6264.128141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6265.071254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6266.194782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.179430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6268.438020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6269.443860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6270.500724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6271.435021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6272.449206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6273.637974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6274.678468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6275.759792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6277.003705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6278.377159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.473315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6280.519661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6281.688922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.025710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.967558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6285.094303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.266627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6287.248447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6288.465358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6289.416500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6290.474565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6291.514802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.430344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6293.420920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6294.389382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6295.358222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.348239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6297.186060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6298.098640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6299.073489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6300.367436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6301.543125] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6301.558988] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6301.571846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6302.692491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6303.644278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6304.654569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6305.751914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6306.985899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6308.162299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6309.279842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6310.744252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6311.980990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6313.504267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6314.775068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6316.292791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6317.213556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6318.469072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6319.789027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6320.616713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6321.744824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6322.962874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.144371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.941803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6325.866515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6326.862058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6327.974347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6328.775469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6329.985428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.071332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6332.281423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6333.373385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6334.612648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6335.654941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6336.700812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6337.855186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6338.892990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6340.059952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6341.406843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6342.582832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6343.657782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6344.674561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6345.811074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6346.577111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6347.610547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6348.812958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6350.194487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6351.405454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6352.552353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6353.575662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6354.542117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6355.759101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.862451] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6356.873241] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 1 previous similar message [ 6356.874972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.885672] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6356.885684] LustreError: 162906:0:(osp_precreate.c:1355:osp_precreate_thread()) Skipped 1 previous similar message [ 6357.831567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6358.976940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.941222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6360.984677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6362.096842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6363.066528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6364.243342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6365.283079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6366.590134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.076248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6369.401155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6370.586833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6371.752523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6372.787394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6373.861745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6375.070801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6376.211847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6377.745128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6379.188443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6380.275101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6381.374464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6382.689936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6383.825557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.076359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6386.358359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6387.433810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6388.679762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6390.150629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6391.226406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6392.289837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.467740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6394.579808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6395.711362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6396.838696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6397.866688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6398.915825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6399.884987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6401.101242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6401.958381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6402.999874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6404.105280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6405.057825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6405.907377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6406.749910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6407.762073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6408.612590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6409.700505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6410.809848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6411.915728] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6411.924327] Lustre: Skipped 475 previous similar messages [ 6411.949594] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6411.963163] Lustre: Skipped 475 previous similar messages [ 6411.970126] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6411.985473] Lustre: Skipped 475 previous similar messages [ 6411.999027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.027885] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6412.043402] Lustre: Skipped 475 previous similar messages [ 6412.920311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6414.018738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6415.033015] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6416.048760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6417.126918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6418.149940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6419.145576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6420.270594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6421.466249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6422.451977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.532231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6424.595868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6425.710586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6426.839671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6427.884429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6429.052309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6430.359742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.571529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6432.723688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6433.840881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6434.980779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6436.035443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.038190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.999540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6438.988667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6440.022770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6440.928544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6441.925420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6442.892090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6443.911704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6444.707472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6445.708291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6446.561042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6447.523747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6448.313499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6449.258498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6450.288384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6451.205044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6452.190223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6453.079690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6453.964570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6454.810390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6455.850778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6456.832851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6457.776791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6458.658641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6459.698711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6460.788058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7016.047993] LustreError: 164484:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 7016.075097] LustreError: 162906:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 7837.678816] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7837.682112] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7837.713974] Lustre: Skipped 49 previous similar messages [ 7837.740087] Lustre: Skipped 1 previous similar message [ 7839.152245] Lustre: server umount lustre-OST0000 complete [ 7846.881913] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7846.888205] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7847.911481] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7849.399554] Lustre: server umount lustre-MDT0000 complete [ 7853.030544] LustreError: 163597:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7853.050835] LustreError: 163597:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7853.238187] LustreError: 162867:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775772309 with bad export cookie 1898611490159953287 [ 7853.250530] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7853.257620] LustreError: 162867:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7853.743507] Lustre: server umount lustre-MDT0001 complete [ 7864.808327] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 7867.241041] Key type lgssc unregistered [ 7867.529087] LNet: 217862:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7867.537461] LNetError: 217862:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7867.552948] LNet: Removed LNI 192.168.204.121@tcp [ 7868.360292] Key type .llcrypt unregistered [ 7868.367890] Key type ._llcrypt unregistered [ 7891.725978] Key type ._llcrypt registered [ 7891.734434] Key type .llcrypt registered [ 7891.886403] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 7893.087371] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7893.215033] alg: No test for adler32 (adler32-zlib) [ 7894.248410] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 7894.481991] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 7896.167187] Key type lgssc registered [ 7897.284877] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7905.055502] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7905.096565] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7906.560665] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7910.519727] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 7917.028123] LustreError: 219264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7917.046075] LustreError: 219264:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7918.685047] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7919.093328] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7923.579235] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 7928.814672] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7932.679571] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7939.288572] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7939.639619] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7945.774102] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 7951.925455] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 7952.290317] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7958.449921] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 7960.102603] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7960.113155] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 7960.118394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7960.128644] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7960.136672] LustreError: 219284:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 7962.092857] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7962.103466] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7962.108833] Lustre: Skipped 1 previous similar message [ 7965.321997] Lustre: lustre-OST0000: Not available for connect from 192.168.204.21@tcp (stopping) [ 7967.205383] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7967.219049] Lustre: Skipped 1 previous similar message [ 7968.315415] Lustre: server umount lustre-OST0000 complete [ 7980.143136] LustreError: 219284:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 8001.558064] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8001.912296] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8007.790487] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8013.176274] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8014.450315] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 8017.280792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8017.302232] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8017.306318] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 8017.328285] Lustre: Skipped 1 previous similar message [ 8017.674854] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff922aa0435800.ost_server_uuid 50 [ 8019.467268] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff922aa0435800.ost_server_uuid in FULL state after 0 sec [ 8022.498204] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8022.503580] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8022.514522] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8022.522050] Lustre: Skipped 2 previous similar messages [ 8022.532379] Lustre: Skipped 1 previous similar message [ 8024.635981] Lustre: server umount lustre-OST0000 complete [ 8031.725487] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8031.749711] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8031.769826] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8034.762645] Lustre: server umount lustre-MDT0000 complete [ 8037.860098] LustreError: 219976:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8037.878707] LustreError: 219976:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8040.044501] LustreError: 219246:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775772495 with bad export cookie 4429126447511225527 [ 8040.049524] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8040.072593] LustreError: 219246:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8040.599471] Lustre: server umount lustre-MDT0001 complete [ 8052.972807] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 8055.306504] Key type lgssc unregistered [ 8055.542880] LNet: 223914:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8055.555683] LNetError: 223914:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8055.604309] LNet: Removed LNI 192.168.204.121@tcp [ 8056.636114] Key type .llcrypt unregistered [ 8056.638059] Key type ._llcrypt unregistered [ 8089.741399] Key type ._llcrypt registered [ 8089.745961] Key type .llcrypt registered [ 8089.831674] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 8091.593584] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8091.605603] alg: No test for adler32 (adler32-zlib) [ 8093.316102] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 8093.543795] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 8095.426928] Key type lgssc registered [ 8097.898814] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8112.263616] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8112.320132] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8114.129718] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8119.806736] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8123.362478] LustreError: 225625:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8123.385057] LustreError: 225625:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8128.484445] LustreError: 225626:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8128.764898] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8129.345571] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8133.853319] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8136.815358] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8143.695904] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8144.279276] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8150.228808] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8158.640251] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 8159.782204] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8160.104703] Lustre: lustre-OST0001: new disk, initializing [ 8160.108330] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8160.201821] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8166.525055] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8166.532621] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8166.651684] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8166.758668] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8178.397213] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8182.975257] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8205.801477] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8205.809669] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8205.831866] Lustre: Skipped 1 previous similar message [ 8205.856447] Lustre: Skipped 3 previous similar messages [ 8210.912224] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8210.925483] Lustre: Skipped 3 previous similar messages [ 8211.639820] Lustre: server umount lustre-MDT0000 complete [ 8215.462174] LustreError: 225605:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775772671 with bad export cookie 9366357226240620833 [ 8215.470756] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8215.492365] LustreError: 225605:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8215.830154] Lustre: server umount lustre-MDT0001 complete [ 8230.249801] Lustre: server umount lustre-OST0000 complete [ 8231.200725] Lustre: 224886:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775772671/real 1775772671] req@ffff91a66698d180 x1862032476438656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775772687 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8231.224843] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8231.238315] Lustre: Skipped 2 previous similar messages [ 8234.667422] Lustre: server umount lustre-OST0001 complete [ 8255.224485] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 8265.118098] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8265.620199] LustreError: 230968:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8265.752057] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8269.988600] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8270.817282] LustreError: 230969:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8275.943959] LustreError: 230968:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8279.859685] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8280.657212] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8287.004433] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8290.313976] Lustre: 232076:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8297.601189] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8298.134955] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8304.999912] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8305.327057] LustreError: 232431:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8310.468139] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49761) [ 8315.029651] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8321.768107] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8329.004786] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8332.295778] Lustre: 233922:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8351.205934] Lustre: mylustre-MDT0000-lwp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8351.223677] Lustre: Skipped 3 previous similar messages [ 8351.226915] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8351.265459] Lustre: Skipped 3 previous similar messages [ 8355.057885] Lustre: server umount mylustre-MDT0000 complete [ 8356.323743] LustreError: 231684:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8356.347037] LustreError: 231684:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 8359.010751] LustreError: 230945:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775772814 with bad export cookie 9366357226240623605 [ 8359.015829] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8359.021956] LustreError: 230945:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8359.372318] Lustre: server umount mylustre-MDT0001 complete [ 8373.991152] Lustre: server umount mylustre-OST0000 complete [ 8377.567388] Lustre: 224887:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775772817/real 1775772817] req@ffff91a64c4a4700 x1862032476502016/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775772833 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8377.622811] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8378.406484] Lustre: server umount mylustre-OST0001 complete [ 8399.226525] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 8410.286042] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8410.841502] LustreError: 236214:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8410.992786] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8411.006772] Lustre: Skipped 1 previous similar message [ 8415.291830] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8423.970088] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8428.140319] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8430.777542] Lustre: 237321:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8436.716513] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8442.880270] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8451.159228] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8455.280804] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49793) [ 8455.281738] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 8457.063747] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8464.646975] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8468.601539] Lustre: 239163:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8480.736280] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8480.750827] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8480.780252] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 8485.925468] Lustre: server umount tfs-MDT0000 complete [ 8486.371527] LustreError: 236209:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8486.389162] LustreError: 236209:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 8489.219863] LustreError: 236191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775772945 with bad export cookie 9366357226240625271 [ 8489.222396] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8489.240520] LustreError: 236191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8489.519458] Lustre: server umount tfs-MDT0001 complete [ 8503.758911] Lustre: server umount tfs-OST0000 complete [ 8507.680363] Lustre: 224886:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775772947/real 1775772947] req@ffff91a77a714a80 x1862032476553472/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775772963 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8507.705355] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8507.720895] Lustre: Skipped 3 previous similar messages [ 8507.926321] Lustre: server umount tfs-OST0001 complete [ 8531.781706] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 8543.481890] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8544.065984] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8544.078967] Lustre: Skipped 3 previous similar messages [ 8549.122968] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8559.001506] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8564.325512] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8567.874237] Lustre: 242508:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8576.755621] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8585.405775] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8588.605516] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49825) [ 8599.105884] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8601.320238] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 8607.641467] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8615.478537] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8619.389647] Lustre: 244354:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8632.275245] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 18:18:06 (1775773086) [ 8650.720635] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8650.746262] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8650.750679] Lustre: Skipped 3 previous similar messages [ 8650.771463] Lustre: Skipped 7 previous similar messages [ 8655.181421] Lustre: server umount lustre-MDT0000 complete [ 8655.841170] LustreError: 241393:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8655.873451] LustreError: 241393:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 15 previous similar messages [ 8660.249802] LustreError: 241373:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775773116 with bad export cookie 9366357226240626937 [ 8660.268262] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8660.291195] LustreError: 241373:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8660.966184] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8660.982902] Lustre: Skipped 1 previous similar message [ 8666.837471] Lustre: server umount lustre-MDT0001 complete [ 8686.047941] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8686.261857] Lustre: server umount lustre-OST0000 complete [ 8696.924155] Lustre: server umount lustre-OST0001 complete [ 8704.120579] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 8714.443507] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 8753.490076] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 8753.490076] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 8753.490076] [ 8753.564269] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 8753.929255] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8753.986966] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8754.107295] Lustre: lustre-MDT0000: new disk, initializing [ 8754.234886] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8754.240498] Lustre: Skipped 3 previous similar messages [ 8754.278593] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8760.369820] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8771.505099] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 8771.505099] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 8771.505099] [ 8771.527569] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 8771.636971] Lustre: 247506:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8771.726953] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8771.733288] Lustre: Skipped 1 previous similar message [ 8771.798902] Lustre: lustre-MDT0001: new disk, initializing [ 8771.963747] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8771.974526] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8776.875718] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8787.618822] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8787.941324] Lustre: lustre-OST0000: new disk, initializing [ 8787.946052] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8789.056825] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8789.064134] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8789.237718] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8793.968071] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8803.898537] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8804.047559] Lustre: lustre-OST0001: new disk, initializing [ 8804.058911] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8805.550861] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8805.565568] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8810.088409] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8810.997258] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8821.174720] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 18:21:15 (1775773275) [ 8836.424673] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 18:21:31 (1775773291) [ 8851.955517] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8851.964150] Lustre: Skipped 2 previous similar messages [ 8851.971233] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8851.976912] Lustre: Skipped 3 previous similar messages [ 8857.350782] Lustre: server umount lustre-OST0000 complete [ 8867.644246] Lustre: server umount lustre-MDT0000 complete [ 8872.451919] LustreError: 247497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775773328 with bad export cookie 9366357226240628491 [ 8872.456150] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8872.462965] LustreError: 247497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8879.293473] Lustre: server umount lustre-MDT0001 complete [ 8895.239446] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 8911.377382] Lustre: server umount lustre-OST0001 complete [ 8918.864516] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 8936.630219] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 8979.121794] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8979.391854] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8979.428454] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8979.544860] Lustre: lustre-MDT0000: new disk, initializing [ 8979.666624] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8984.603298] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 8995.101466] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8995.196214] Lustre: 254400:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8995.435513] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9000.200678] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9008.870669] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9012.585917] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9020.009203] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9020.300348] Lustre: lustre-OST0000: new disk, initializing [ 9020.309259] Lustre: Skipped 1 previous similar message [ 9020.313211] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9020.318995] Lustre: Skipped 2 previous similar messages [ 9020.464416] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9020.474839] Lustre: Skipped 5 previous similar messages [ 9021.547899] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9021.569105] Lustre: Skipped 1 previous similar message [ 9021.574588] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9021.701374] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9028.073335] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9036.355288] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9047.522386] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9047.523236] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9047.529550] LustreError: Skipped 1 previous similar message [ 9047.530512] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9047.537748] Lustre: Skipped 6 previous similar messages [ 9047.550844] Lustre: Skipped 10 previous similar messages [ 9049.308703] Lustre: server umount lustre-OST0000 complete [ 9056.737542] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9059.405378] Lustre: server umount lustre-MDT0000 complete [ 9062.884092] LustreError: 254414:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9062.921854] LustreError: 254414:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 12 previous similar messages [ 9063.467229] LustreError: 254393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775773519 with bad export cookie 9366357226240629961 [ 9063.470281] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9063.482216] LustreError: 254393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9063.827061] Lustre: server umount lustre-MDT0001 complete [ 9075.402320] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 9078.256035] Key type lgssc unregistered [ 9078.540803] LNet: 257774:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9078.564180] LNetError: 257774:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9078.584588] LNet: Removed LNI 192.168.204.121@tcp [ 9079.448295] Key type .llcrypt unregistered [ 9079.452592] Key type ._llcrypt unregistered [ 9106.548288] Key type ._llcrypt registered [ 9106.551273] Key type .llcrypt registered [ 9106.632718] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 9107.677624] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9107.718831] alg: No test for adler32 (adler32-zlib) [ 9108.765972] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 9109.034194] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 9110.703266] Key type lgssc registered [ 9111.861790] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9119.909963] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9119.945506] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9121.610887] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9126.257318] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9132.016791] LustreError: 259217:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9132.036819] LustreError: 259217:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9135.408124] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9135.969147] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9140.326866] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9147.251143] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9151.879715] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9159.345287] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9159.660298] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9166.005595] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9166.864225] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 9173.173695] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9174.552627] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 9181.152900] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9181.170244] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9181.189615] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9182.180293] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9182.188487] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9182.191819] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9182.199557] Lustre: Skipped 1 previous similar message [ 9183.771517] Lustre: server umount lustre-OST0000 complete [ 9192.417856] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9192.440960] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9192.454881] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9192.457580] Lustre: Skipped 1 previous similar message [ 9195.578771] Lustre: server umount lustre-MDT0000 complete [ 9197.540325] LustreError: 260659:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9197.571951] LustreError: 260659:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9200.669503] LustreError: 260835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775773656 with bad export cookie 1918974565544047802 [ 9200.682794] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9201.261023] Lustre: server umount lustre-MDT0001 complete [ 9215.031273] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 9218.622147] Key type lgssc unregistered [ 9218.944189] LNet: 262453:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9218.952931] LNetError: 262453:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9218.971585] LNet: Removed LNI 192.168.204.121@tcp [ 9220.125728] Key type .llcrypt unregistered [ 9220.132929] Key type ._llcrypt unregistered [ 9242.604531] Key type ._llcrypt registered [ 9242.610205] Key type .llcrypt registered [ 9242.780584] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 9244.712197] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9244.956049] alg: No test for adler32 (adler32-zlib) [ 9246.602912] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 9247.183785] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 9248.992738] Key type lgssc registered [ 9252.433373] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9269.896878] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9269.962922] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9285.727439] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 9290.847425] LustreError: 263662:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.121@tcp: failed processing log, type 4: rc = -110 [ 9317.535214] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9324.083518] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9330.869594] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9333.230653] Lustre: server umount lustre-OST0000 complete [ 9352.585458] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 9356.492890] Key type lgssc unregistered [ 9357.089728] LNet: 265164:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9357.099481] LNetError: 265164:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9357.141747] LNet: Removed LNI 192.168.204.121@tcp [ 9358.553523] Key type .llcrypt unregistered [ 9358.555211] Key type ._llcrypt unregistered [ 9426.960621] Key type ._llcrypt registered [ 9426.963828] Key type .llcrypt registered [ 9427.080887] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 9428.955415] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9429.424080] alg: No test for adler32 (adler32-zlib) [ 9431.466450] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [ 9431.959708] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [ 9433.934568] Key type lgssc registered [ 9435.840320] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9457.286827] loop0: detected capacity change from 0 to 204800000 [ 9457.564349] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9457.582027] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9458.106559] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9459.501962] loop0: detected capacity change from 0 to 204800000 [ 9459.683257] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9459.711610] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9460.186415] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9461.399256] loop0: detected capacity change from 0 to 204800000 [ 9461.610614] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9461.629915] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9461.826205] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9463.053338] loop0: detected capacity change from 0 to 204800000 [ 9463.252659] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9463.266233] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9463.386377] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9464.415875] loop0: detected capacity change from 0 to 204800000 [ 9464.462284] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9469.058322] loop0: detected capacity change from 0 to 204800000 [ 9469.084796] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9473.148148] loop0: detected capacity change from 0 to 204800000 [ 9473.179434] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9477.631774] loop0: detected capacity change from 0 to 204800000 [ 9477.660895] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9481.948290] loop0: detected capacity change from 0 to 204800000 [ 9482.057360] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9482.124664] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9482.209835] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9482.220251] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 9482.230814] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 9482.244392] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9482.252832] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 9482.264404] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9482.275420] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9482.287522] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 9482.298350] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 9482.308994] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 9482.326865] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 9482.337179] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 9482.359703] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 9482.373685] Lustre: 268565:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 9488.420726] Lustre: server umount MGS complete [ 9489.573496] loop0: detected capacity change from 0 to 204800000 [ 9489.704627] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9490.437467] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9490.487073] Lustre: lustre-MDT0000: Aborting client recovery [ 9491.382335] loop1: detected capacity change from 0 to 204800000 [ 9491.550098] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9491.626951] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9491.638527] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9491.655948] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9491.665933] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 9491.677772] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 9491.687930] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9491.695768] Lustre: 268999:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 9491.708325] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9491.929143] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9492.000902] Lustre: lustre-MDT0001: Aborting client recovery [ 9493.249993] loop2: detected capacity change from 0 to 204800000 [ 9493.355102] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9493.431323] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9493.438946] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9493.446922] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9493.455840] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9493.463455] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9493.470167] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9493.476729] Lustre: 269077:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9493.552567] Lustre: Found index 0 for lustre-OST0000, updating log [ 9493.620219] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9493.641477] Lustre: lustre-OST0000: Aborting recovery [ 9494.521120] loop3: detected capacity change from 0 to 204800000 [ 9494.615913] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9494.722991] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9494.735713] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9494.747568] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9494.762811] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9494.772778] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9494.782473] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9494.796996] Lustre: 269161:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9494.818943] Lustre: Found index 1 for lustre-OST0001, updating log [ 9494.962222] Lustre: lustre-OST0001: Aborting recovery [ 9500.177269] LustreError: 268943:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 9501.162079] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 9501.162536] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9501.163691] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9501.175837] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 9501.186756] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 9501.221502] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 9503.843329] LustreError: 268910:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 1152us: rc = -2 [ 9504.368528] LustreError: 269105:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 709us: rc = -2 [ 9504.398528] LustreError: 269105:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 14 previous similar messages [ 9521.635109] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9521.639225] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9521.665805] Lustre: Skipped 3 previous similar messages [ 9521.685119] Lustre: Skipped 3 previous similar messages [ 9526.000212] Lustre: server umount lustre-MDT0000 complete [ 9526.758223] LustreError: 268908:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9526.798980] LustreError: 268908:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 9527.146697] LustreError: 269512:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775773983 with bad export cookie 18109265010412122270 [ 9527.157488] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9527.163455] LustreError: 269512:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9531.871835] LustreError: 268909:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9531.875216] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9531.891237] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9532.904431] LustreError: 269105:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9532.904513] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9532.904517] Lustre: Skipped 1 previous similar message [ 9532.928837] LustreError: 269105:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9533.946887] Lustre: server umount lustre-MDT0001 complete [ 9541.737719] Lustre: server umount lustre-OST0000 complete [ 9549.936231] Lustre: server umount lustre-OST0001 complete [ 9558.399456] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 18:33:33 (1775774013) [ 9589.554932] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [ 9600.771313] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [ 9646.651274] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9646.929402] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9646.968476] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9647.055695] Lustre: lustre-MDT0000: new disk, initializing [ 9647.120752] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9647.127694] Lustre: Skipped 1 previous similar message [ 9647.143468] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9651.115299] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9662.639824] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9662.769390] Lustre: 273211:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9662.828975] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9662.833946] Lustre: Skipped 1 previous similar message [ 9662.908814] Lustre: lustre-MDT0001: new disk, initializing [ 9663.046404] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9663.104438] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9663.123960] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9667.638108] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9676.192392] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9680.942404] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9689.127595] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9689.531159] Lustre: lustre-OST0000: new disk, initializing [ 9689.539324] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9689.721111] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9696.874108] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9696.890216] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9697.006753] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9697.541414] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9705.499896] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9710.807852] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9722.229747] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9728.926649] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9784.294361] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9784.299194] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9784.306023] LustreError: Skipped 1 previous similar message [ 9784.328255] Lustre: Skipped 1 previous similar message [ 9784.340924] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9784.348555] Lustre: Skipped 2 previous similar messages [ 9787.485411] Lustre: server umount lustre-OST0000 complete [ 9794.530934] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9794.558897] Lustre: Skipped 1 previous similar message [ 9794.568597] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9794.578220] Lustre: Skipped 1 previous similar message [ 9804.769692] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9804.779082] Lustre: Skipped 3 previous similar messages [ 9806.305231] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9806.431916] Lustre: server umount lustre-MDT0000 complete [ 9809.888688] LustreError: 273217:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9809.904612] LustreError: 273217:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9810.310962] LustreError: 273202:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775774266 with bad export cookie 18109265010412124979 [ 9810.316896] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9810.321143] LustreError: 273202:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9810.756463] Lustre: server umount lustre-MDT0001 complete [ 9820.695443] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9825.827451] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9832.965691] Lustre: server umount MGS complete [ 9846.085044] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9846.655407] LustreError: 278691:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9846.685310] LustreError: 278704:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9846.779139] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9851.570877] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9857.009493] LustreError: 278692:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9857.048759] LustreError: 278692:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9861.552196] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9868.461569] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9876.372663] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9880.728280] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9888.422910] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9888.934226] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9888.947048] Lustre: Skipped 1 previous similar message [ 9895.994746] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [ 9902.467414] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9933.282926] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9933.309821] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9933.336067] Lustre: Skipped 1 previous similar message [ 9933.342752] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9937.375955] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9947.103156] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9947.449111] Lustre: server umount lustre-OST0000 complete [ 9952.737383] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9952.746412] Lustre: Skipped 2 previous similar messages [ 9957.848335] Lustre: server umount lustre-MDT0000 complete [ 9957.866104] LustreError: 278686:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9957.908734] LustreError: 278686:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9962.739954] LustreError: 278672:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775774418 with bad export cookie 18109265010412126855 [ 9962.741403] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9962.756592] LustreError: 278672:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9963.121384] Lustre: server umount lustre-MDT0001 complete [ 9979.053753] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [ 9983.366860] Key type lgssc unregistered [ 9983.861840] LNet: 282289:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9983.899288] LNetError: 282289:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9983.934410] LNet: Removed LNI 192.168.204.121@tcp [ 9985.015880] Key type .llcrypt unregistered [ 9985.017374] Key type ._llcrypt unregistered [10025.291450] Key type ._llcrypt registered [10025.293135] Key type .llcrypt registered [10025.390904] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [10040.398959] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [10041.434810] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10041.663265] alg: No test for adler32 (adler32-zlib) [10042.737741] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [10042.971319] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [10044.688429] Key type lgssc registered [10045.931252] Lustre: Echo OBD driver; http://www.lustre.org/ [10085.533497] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10085.601194] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10086.990831] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10087.027734] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10087.103623] Lustre: lustre-MDT0000: new disk, initializing [10087.164618] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10087.183571] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10091.604723] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10102.946511] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10103.085536] Lustre: 286217:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10103.153422] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10103.161831] Lustre: Skipped 1 previous similar message [10103.248899] Lustre: lustre-MDT0001: new disk, initializing [10103.335115] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10103.370901] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10103.385027] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10108.375917] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10116.258201] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10120.589650] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10129.723439] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10130.252953] Lustre: lustre-OST0000: new disk, initializing [10130.268944] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10130.484534] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10138.230159] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10138.239864] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10138.413474] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10139.031287] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10147.822679] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10156.633866] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [10166.495673] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [10171.128789] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [10178.299226] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [10220.512577] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10220.530936] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10220.565021] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10225.643435] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10225.666631] Lustre: Skipped 2 previous similar messages [10230.754693] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10230.767994] Lustre: Skipped 1 previous similar message [10233.311172] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10233.783104] Lustre: server umount lustre-OST0000 complete [10240.994143] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10241.014847] Lustre: Skipped 1 previous similar message [10241.020276] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10241.032468] Lustre: Skipped 1 previous similar message [10246.116939] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10246.121326] Lustre: Skipped 1 previous similar message [10253.279172] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10253.914340] Lustre: server umount lustre-MDT0000 complete [10258.970158] LustreError: 286207:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775774714 with bad export cookie 17059331504627987362 [10258.984942] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10258.999685] LustreError: 286207:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10259.454331] Lustre: server umount lustre-MDT0001 complete [10271.203784] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10276.829812] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10283.161755] Lustre: server umount MGS complete [10296.095155] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10296.621557] LustreError: 291608:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10296.641572] LustreError: 291608:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [10296.656946] LustreError: 291621:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [10296.721705] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10301.388054] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10301.923644] LustreError: 291609:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10307.042116] LustreError: 291608:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10311.919948] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10312.161685] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [10312.176020] Lustre: Skipped 2 previous similar messages [10312.319557] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10316.574629] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10322.438719] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10326.479843] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10334.305306] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10334.806915] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10341.555439] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10347.957455] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10383.328840] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10383.338722] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10383.352349] LustreError: Skipped 1 previous similar message [10383.381797] Lustre: Skipped 1 previous similar message [10383.395891] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10388.448918] LustreError: 293204:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10388.480270] LustreError: 293204:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10388.728991] Lustre: server umount lustre-OST0000 complete [10398.689526] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10398.732766] Lustre: Skipped 1 previous similar message [10403.178535] Lustre: server umount lustre-MDT0000 complete [10403.812347] LustreError: 292629:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10403.839248] LustreError: 292629:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10408.265571] LustreError: 291588:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775774864 with bad export cookie 17059331504627989301 [10408.266428] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10408.282529] LustreError: 291588:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10408.891910] Lustre: server umount lustre-MDT0001 complete [10421.602654] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [10424.810677] Key type lgssc unregistered [10425.185712] LNet: 295202:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10425.197884] LNetError: 295202:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10425.215136] LNet: Removed LNI 192.168.204.121@tcp [10426.241582] Key type .llcrypt unregistered [10426.244383] Key type ._llcrypt unregistered [10455.550196] Key type ._llcrypt registered [10455.556079] Key type .llcrypt registered [10455.708760] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [10471.630584] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [10473.100175] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10473.473896] alg: No test for adler32 (adler32-zlib) [10474.714811] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [10475.108862] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [10476.855727] Key type lgssc registered [10478.482666] Lustre: Echo OBD driver; http://www.lustre.org/ [10507.765495] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [10524.825083] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10524.851102] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10526.380184] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10526.441451] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10526.620895] Lustre: lustre-MDT0000: new disk, initializing [10526.770215] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10526.799054] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10531.771414] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10545.658755] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10545.997309] Lustre: lustre-OST0000: new disk, initializing [10546.009734] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10546.014924] Lustre: Skipped 1 previous similar message [10546.121058] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10553.732736] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [10553.979260] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [10553.992690] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [10554.055457] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [11629.024418] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11629.045544] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11633.153743] Lustre: server umount lustre-MDT0000 complete [11636.903820] LustreError: 298391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775776092 with bad export cookie 5537147643982680818 [11636.910506] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11636.920480] LustreError: 298391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [11637.113215] Lustre: server umount lustre-OST0000 complete [11663.587494] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [11675.413231] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [11716.033272] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11716.369202] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11716.410451] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11716.481335] Lustre: lustre-MDT0000: new disk, initializing [11716.574295] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11716.595775] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11721.408799] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11733.229283] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11733.353435] Lustre: 303520:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11733.444624] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11733.451201] Lustre: Skipped 1 previous similar message [11733.620816] Lustre: lustre-MDT0001: new disk, initializing [11733.716540] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11733.756371] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11733.764394] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11738.467887] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11747.477282] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11752.334932] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11759.570797] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11759.840078] Lustre: lustre-OST0000: new disk, initializing [11759.845151] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11759.943376] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11765.594105] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11766.332697] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11766.352777] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11766.454432] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11773.400142] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11778.895927] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11779.115901] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11784.168933] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11784.384879] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11787.247414] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11787.250338] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11787.262709] LustreError: Skipped 1 previous similar message [11787.265447] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11787.275442] Lustre: Skipped 1 previous similar message [11787.307490] Lustre: Skipped 1 previous similar message [11792.455534] Lustre: server umount lustre-OST0000 complete [11797.475049] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11797.492256] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11802.593561] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11802.605094] Lustre: Skipped 2 previous similar messages [11802.892978] Lustre: server umount lustre-MDT0000 complete [11806.865879] LustreError: 303513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775776262 with bad export cookie 5537147643985621637 [11806.876201] LustreError: 303513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11806.877340] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11807.187244] Lustre: server umount lustre-MDT0001 complete [11810.605473] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [11812.427305] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 19:11:07 (1775776267) [11820.096818] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11820.604716] LustreError: 307429:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11820.625351] LustreError: 307429:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11820.706168] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11825.564351] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11826.146801] LustreError: 307430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11830.242713] LustreError: 307429:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11835.363674] LustreError: 307430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11835.938505] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11836.410492] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11841.278480] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11849.129312] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11855.187112] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11865.789976] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11866.088438] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [11866.211776] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11872.905481] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11879.161571] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11888.304187] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11888.479273] Lustre: lustre-OST0001: new disk, initializing [11888.482849] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [11888.570395] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11894.933337] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [11894.951284] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [11895.011400] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [11895.033427] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11895.048198] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [11896.103679] LustreError: 310260:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11896.118517] LustreError: 310260:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [11897.121612] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11899.176620] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11899.191464] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [11903.337372] LustreError: 310260:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11903.355673] LustreError: 310260:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 8 previous similar messages [11906.061298] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11906.300298] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11911.290161] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff922a878f5800.ost_server_uuid 50 [11911.649503] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11911.668052] LustreError: 310273:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages [11913.099580] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff922a878f5800.ost_server_uuid in FULL state after 0 sec [11917.559543] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff922a878f5800.ost_server_uuid 50 [11919.707371] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff922a878f5800.ost_server_uuid in FULL state after 0 sec [11921.987303] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [11936.400147] Lustre: lustre-OST0001: Not available for connect from 192.168.204.21@tcp (stopping) [11937.253255] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11937.263882] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11937.287488] Lustre: Skipped 1 previous similar message [11941.484666] LustreError: 310274:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.204.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11941.597555] Lustre: server umount lustre-OST0001 complete [11949.538169] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11949.539286] LustreError: 309025:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11949.553974] Lustre: Skipped 2 previous similar messages [11949.583799] LustreError: 309025:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11950.658579] Lustre: server umount lustre-OST0000 complete [11959.270106] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11959.278813] LustreError: Skipped 1 previous similar message [11959.287276] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11959.302932] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11959.310424] Lustre: Skipped 6 previous similar messages [11961.487378] Lustre: server umount lustre-MDT0000 complete [11966.085671] LustreError: 307411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775776422 with bad export cookie 5537147643985622519 [11966.096599] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11966.106938] LustreError: 307411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [11967.112210] Lustre: server umount lustre-MDT0001 complete [11980.829213] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [11984.217300] Key type lgssc unregistered [11984.446055] LNet: 312375:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11984.456480] LNetError: 312375:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11984.487043] LNet: Removed LNI 192.168.204.121@tcp [11985.553700] Key type .llcrypt unregistered [11985.559091] Key type ._llcrypt unregistered [12014.864709] Key type ._llcrypt registered [12014.868450] Key type .llcrypt registered [12015.087322] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [12017.084768] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12017.116407] alg: No test for adler32 (adler32-zlib) [12018.336447] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [12018.709792] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [12020.496062] Key type lgssc registered [12022.416740] Lustre: Echo OBD driver; http://www.lustre.org/ [12033.676895] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [12033.783668] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12035.673197] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12042.704161] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12045.796967] LustreError: 313783:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12045.828448] LustreError: 313783:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12050.919767] LustreError: 313782:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12051.495785] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12056.044042] LustreError: 313783:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12059.860666] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12060.135726] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [12060.340144] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12066.126179] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12078.272517] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12078.910214] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12080.963039] LustreError: 315335:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12081.003118] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [12085.105878] LustreError: 315335:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12085.136711] LustreError: 315335:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12087.456363] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12094.629517] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12095.461659] LustreError: 315333:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12095.479247] LustreError: 315333:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [12103.506237] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12103.908228] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [12109.337822] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [12111.190093] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12117.993685] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [12127.070958] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [12127.328304] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [12242.419262] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [12242.423603] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12242.428902] LustreError: Skipped 1 previous similar message [12242.432312] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [12242.467621] Lustre: Skipped 1 previous similar message [12245.361812] Lustre: server umount lustre-OST0001 complete [12247.526796] LustreError: 315334:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12247.566188] LustreError: 315334:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [12254.179333] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [12254.188243] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12254.194714] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12254.201273] Lustre: Skipped 1 previous similar message [12255.201244] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [12255.210195] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12257.767498] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12257.770817] Lustre: Skipped 1 previous similar message [12259.215687] Lustre: server umount lustre-OST0000 complete [12262.885542] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12262.897301] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12268.923846] Lustre: server umount lustre-MDT0000 complete [12272.196179] LustreError: 317108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775776728 with bad export cookie 2227937828492715450 [12272.201585] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12272.205485] LustreError: 317108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [12272.437788] Lustre: server umount lustre-MDT0001 complete [12282.878223] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [12285.572941] Key type lgssc unregistered [12285.818811] LNet: 318349:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12285.824677] LNetError: 318349:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [12285.845449] LNet: Removed LNI 192.168.204.121@tcp [12286.807578] Key type .llcrypt unregistered [12286.809669] Key type ._llcrypt unregistered [12335.132073] Key type ._llcrypt registered [12335.134934] Key type .llcrypt registered [12335.269510] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [12336.385423] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12336.586272] alg: No test for adler32 (adler32-zlib) [12337.821786] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [12338.404168] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [12340.103621] Key type lgssc registered [12342.063303] Lustre: Echo OBD driver; http://www.lustre.org/ [12356.643097] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [12356.654980] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12358.044304] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12362.834724] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12367.332580] LustreError: 320624:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12367.343068] LustreError: 320624:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12371.994360] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12372.420341] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12378.293476] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12381.721194] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [12390.822163] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12391.106838] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12396.897560] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12397.268848] LustreError: 322083:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12402.422893] LustreError: 322660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12402.436431] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [12402.443019] LustreError: 322660:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12406.496764] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12406.770539] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [12411.924562] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [12413.348890] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12423.234568] Lustre: DEBUG MARKER: Using TIMEOUT=20 [12433.856592] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [12449.249253] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12449.253322] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12449.260123] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12452.833672] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12452.836019] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12452.838656] Lustre: Skipped 1 previous similar message [12452.848834] Lustre: Skipped 2 previous similar messages [12454.720967] Lustre: server umount lustre-MDT0000 complete [12457.963980] LustreError: 320625:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12458.788352] LustreError: 320605:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775776914 with bad export cookie 891637885293856035 [12458.795784] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12458.797761] LustreError: 320605:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [12459.194488] Lustre: server umount lustre-MDT0001 complete [12474.176389] Lustre: server umount lustre-OST0000 complete [12486.284167] Lustre: server umount lustre-OST0001 complete [12499.969845] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [12509.575899] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12510.076400] LustreError: 325811:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12510.105382] LustreError: 325811:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [12510.210534] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12513.768143] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12520.425984] LustreError: 325812:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12520.452348] LustreError: 325812:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12521.759343] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12522.135710] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12527.148821] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12530.771873] Lustre: 326917:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [12538.948337] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12539.477292] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12546.724313] LustreError: 327273:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12546.813727] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12555.283889] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [12556.721540] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12559.177858] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [12564.249857] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12572.840096] Lustre: DEBUG MARKER: Using TIMEOUT=20 [12576.905756] Lustre: 328763:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [12588.005080] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12588.009829] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12588.013018] Lustre: Skipped 1 previous similar message [12588.024667] Lustre: Skipped 5 previous similar messages [12591.015342] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12591.022869] Lustre: Skipped 3 previous similar messages [12593.377190] Lustre: server umount lustre-MDT0000 complete [12596.213387] LustreError: 326526:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12596.247898] LustreError: 326526:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [12597.662072] LustreError: 326919:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775777053 with bad export cookie 891637885293857736 [12597.667713] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12597.685260] LustreError: 326919:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [12598.164996] Lustre: server umount lustre-MDT0001 complete [12613.233559] Lustre: server umount lustre-OST0000 complete [12617.184786] Lustre: 319887:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775777057/real 1775777057] req@ffff91a6470ae300 x1862036927668608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775777073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [12617.228089] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12617.254640] Lustre: Skipped 2 previous similar messages [12617.482914] Lustre: server umount lustre-OST0001 complete [12621.484991] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [12623.405447] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [12625.949540] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 19:24:40 (1775777080) [12653.372157] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [12664.951202] loop0: detected capacity change from 0 to 1099511627776 [12665.795704] SGI XFS with ACLs, security attributes, quota, no debug enabled [12665.809840] *** VALIDATE xfs *** [12665.830820] XFS (loop0): Mounting V5 Filesystem [12665.872086] XFS (loop0): Ending clean mount [12667.753924] loop1: detected capacity change from 0 to 18691697672192 [12800.456737] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [12813.121922] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [12859.399350] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12859.869610] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12859.914079] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12860.061721] Lustre: lustre-MDT0000: new disk, initializing [12860.262083] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12860.265319] Lustre: Skipped 1 previous similar message [12860.301623] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12865.800577] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12879.788704] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12879.905359] Lustre: 333858:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12879.986827] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12879.996065] Lustre: Skipped 1 previous similar message [12880.103175] Lustre: lustre-MDT0001: new disk, initializing [12880.303572] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12880.311611] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12886.675672] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12896.934953] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12901.656690] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12909.490219] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12909.778223] Lustre: lustre-OST0000: new disk, initializing [12909.782829] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12911.089571] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12911.108053] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12911.260427] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12917.848381] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [12926.976722] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12932.411803] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [12932.753614] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [12938.420514] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [12938.728531] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [12941.792093] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [12941.803908] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12941.805883] LustreError: Skipped 1 previous similar message [12941.807059] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12941.846078] Lustre: Skipped 1 previous similar message [12947.658364] Lustre: server umount lustre-OST0000 complete [12957.161978] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12957.174819] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12957.195662] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12957.238404] Lustre: Skipped 4 previous similar messages [12962.137285] Lustre: server umount lustre-MDT0000 complete [12962.281457] LustreError: 333866:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12962.306223] LustreError: 333866:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12966.637647] LustreError: 333851:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775777422 with bad export cookie 891637885293859290 [12966.646535] LustreError: 333851:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [12966.647265] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12967.221339] Lustre: server umount lustre-MDT0001 complete [12977.629746] XFS (loop0): Unmounting Filesystem [12983.394823] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 19:30:37 (1775777437) [12992.068893] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12992.634625] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12992.640374] Lustre: Skipped 2 previous similar messages [12998.003856] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13008.178241] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13013.854618] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13020.970385] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [13026.054674] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [13034.234510] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [13041.342892] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13047.361862] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13068.769571] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [13068.774636] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13068.784207] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [13068.806025] Lustre: Skipped 2 previous similar messages [13068.824055] Lustre: Skipped 1 previous similar message [13071.265150] Lustre: server umount lustre-OST0000 complete [13075.424274] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [13075.432156] LustreError: Skipped 1 previous similar message [13081.859471] Lustre: server umount lustre-MDT0000 complete [13086.182411] LustreError: 337996:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775777542 with bad export cookie 891637885293860172 [13086.199030] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13086.553987] Lustre: server umount lustre-MDT0001 complete [13098.276846] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [13101.283397] Key type lgssc unregistered [13101.577544] LNet: 341316:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13101.585931] LNetError: 341316:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [13101.599852] LNet: Removed LNI 192.168.204.121@tcp [13102.492182] Key type .llcrypt unregistered [13102.497532] Key type ._llcrypt unregistered [13134.400380] Key type ._llcrypt registered [13134.406395] Key type .llcrypt registered [13134.496535] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [13135.966549] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [13136.037577] alg: No test for adler32 (adler32-zlib) [13137.264657] Lustre: Lustre: Build Version: 2.17.51_76_g43aed12 [13137.558695] LNet: Added LNI 192.168.204.121@tcp [8/256/0/180] [13139.287222] Key type lgssc registered [13140.678685] Lustre: Echo OBD driver; http://www.lustre.org/ [13150.031380] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [13150.071734] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13151.574118] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [13156.485811] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13161.971143] LustreError: 342868:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13161.994641] LustreError: 342868:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [13167.081523] LustreError: 342869:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13167.923747] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13168.510921] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [13173.563206] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13180.362190] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [13184.812848] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [13192.647337] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [13192.946487] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [13200.495887] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13206.983794] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13214.691355] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [13214.700930] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13214.717512] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [13217.763587] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13217.766792] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [13217.805865] Lustre: Skipped 1 previous similar message [13218.962804] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.21@tcp (stopping) [13220.722843] Lustre: server umount lustre-MDT0001 complete [13222.892679] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13222.925383] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [13228.003519] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13228.033570] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [13232.862059] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13233.053666] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [13233.059101] Lustre: Found index 1 for lustre-MDT0001, updating log [13233.127105] Lustre: 342855:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [13233.129648] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13233.163665] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [13233.546920] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [13238.512790] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13238.771852] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [13239.801860] LustreError: 346032:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [13239.812053] LustreError: 346032:0:(tgt_mount.c:666:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [13239.821341] LustreError: 342860:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [13239.897038] LustreError: 346037:0:(obd_config.c:2101:class_config_llog_handler()) MGC192.168.204.121@tcp: cfg command failed: rc = -17 [13239.909106] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [13239.909106] [13545.956181] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13545.959191] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [13545.976384] Lustre: Skipped 1 previous similar message [13545.985370] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [13549.920458] Lustre: server umount lustre-MDT0001 complete [13551.088147] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13551.132423] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [13564.356161] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13564.591680] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [13564.601161] Lustre: Found index 1 for lustre-MDT0001, updating log [13564.648153] Lustre: 342855:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [13565.118347] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [13570.543722] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [13570.544968] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13570.580897] LustreError: 353826:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [13570.594881] LustreError: 353826:0:(tgt_mount.c:666:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [13570.605554] LustreError: 342860:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [13570.615302] LustreError: 342860:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [13570.707509] LustreError: 353834:0:(obd_config.c:760:class_setup()) Device 8 already setup (type osp) [13570.717456] LustreError: 353834:0:(obd_config.c:864:class_detach()) OBD device 8 still set up [13570.729685] LustreError: 353834:0:(obd_config.c:2101:class_config_llog_handler()) MGC192.168.204.121@tcp: cfg command failed: rc = -17 [13570.745318] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.204.121@tcp [13570.745318] [13877.742812] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [13877.750694] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13877.755882] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [13877.785580] Lustre: Skipped 1 previous similar message [13877.793285] Lustre: Skipped 2 previous similar messages [13883.762444] Lustre: server umount lustre-MDT0001 complete [13884.521483] LustreError: 351519:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [13884.545892] LustreError: 351519:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [13895.662322] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13895.784532] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [13895.790781] Lustre: Found index 1 for lustre-MDT0001, updating log [13895.840921] Lustre: 342858:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [13896.326683] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [13901.659251] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [13901.803078] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [13904.893368] LustreError: 362086:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [13904.908154] LustreError: 362086:0:(tgt_mount.c:666:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [13904.925580] LustreError: 342860:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [13904.930846] LustreError: 342860:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [13905.029381] LustreError: 362090:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [13905.052255] LustreError: 362090:0:(obd_config.c:2101:class_config_llog_handler()) MGC192.168.204.121@tcp: cfg command failed: rc = -114 [13905.065250] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [13905.065250] [14228.960127] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [14228.966385] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [14228.979784] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [14228.983957] Lustre: Skipped 3 previous similar messages [14231.865715] Lustre: server umount lustre-MDT0000 complete [14234.596556] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [14234.639518] LustreError: 342863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [14236.557545] LustreError: 342850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775778692 with bad export cookie 17172055480976604809 [14236.562474] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [14236.582338] LustreError: 342850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [14239.715657] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [14239.747944] Lustre: Skipped 2 previous similar messages [14243.281813] Lustre: server umount lustre-MDT0001 complete [14248.301511] Lustre: server umount lustre-OST0000 complete [14259.653468] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [14271.453349] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [14314.556564] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 19:52:49 (1775778769) [14322.590324] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [14323.005611] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [14323.090089] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [14323.270541] Lustre: lustre-MDT0000: new disk, initializing [14323.402821] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [14323.428554] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [14328.923718] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [14343.004885] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [14343.212377] Lustre: 372086:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [14343.313198] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [14343.320854] Lustre: Skipped 1 previous similar message [14343.417607] Lustre: lustre-MDT0001: new disk, initializing [14343.557467] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [14343.633148] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [14343.655835] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [14349.665473] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [14360.284129] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [14366.216466] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [14375.406770] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [14375.799822] Lustre: lustre-OST0000: new disk, initializing [14375.804982] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [14375.899467] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [14381.677980] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [14381.710932] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [14381.852189] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [14383.642988] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug -1 all [14393.613125] Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [14402.533483] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [14402.545760] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [14402.558919] Lustre: Skipped 1 previous similar message [14402.582613] Lustre: Skipped 7 previous similar messages [14408.549154] Lustre: server umount lustre-MDT0000 complete [14412.768735] LustreError: 372098:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [14412.794183] LustreError: 372098:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [14413.459809] LustreError: 372865:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775778869 with bad export cookie 17172055480976606762 [14413.461209] LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [14413.462778] LustreError: 372877:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [14413.472948] LustreError: 372865:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [14413.768801] Lustre: server umount lustre-MDT0001 complete [14429.050360] Lustre: server umount lustre-OST0000 complete [14463.323549] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing set_hostid [14475.546856] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local [14512.004439] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 14182 sec ========= 19:56:05 (1775778965) [14514.436409] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 19:56:08 (1775778968) === [14519.256501] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 19:56:13 (1775778973) === [14567.732948] Lustre: DEBUG MARKER: oleg421-server.virtnet: executing unload_modules_local [14571.426681] Key type lgssc unregistered [14571.870056] LNet: 380037:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [14571.876528] LNetError: 380037:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [14571.890302] LNet: Removed LNI 192.168.204.121@tcp [14572.984080] Key type .llcrypt unregistered [14572.993144] Key type ._llcrypt unregistered