[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 1215527148 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001016] APIC: Switch to symmetric I/O mode setup [ 0.002406] x2apic enabled [ 0.003028] Switched APIC routing to physical x2apic. [ 0.004029] kvm-guest: setup PV IPIs [ 0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008037] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009093] pid_max: default: 32768 minimum: 301 [ 0.011097] LSM: Security Framework initializing [ 0.013059] Yama: becoming mindful. [ 0.014122] SELinux: Initializing. [ 0.016066] *** VALIDATE selinux *** [ 0.035394] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.042410] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.043471] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.044140] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.045266] *** VALIDATE tmpfs *** [ 0.046541] *** VALIDATE proc *** [ 0.048295] *** VALIDATE cgroup *** [ 0.049029] *** VALIDATE cgroup2 *** [ 0.050536] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.051178] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.052010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.053036] Spectre V2 : User space: Vulnerable [ 0.054013] Speculative Store Bypass: Vulnerable [ 0.058021] debug: unmapping init [mem 0xffffffffb2c59000-0xffffffffb2c60fff] [ 0.061606] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.064328] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.065026] ... version: 2 [ 0.066016] ... bit width: 48 [ 0.067013] ... generic registers: 4 [ 0.068017] ... value mask: 0000ffffffffffff [ 0.069012] ... max period: 00007fffffffffff [ 0.070025] ... fixed-purpose events: 3 [ 0.071009] ... event mask: 000000070000000f [ 0.072323] rcu: Hierarchical SRCU implementation. [ 0.074742] smp: Bringing up secondary CPUs ... [ 0.075736] x86: Booting SMP configuration: [ 0.076023] .... node #0, CPUs: #1 #2 #3 [ 0.192600] smp: Brought up 1 node, 4 CPUs [ 0.194014] smpboot: Max logical packages: 1 [ 0.195021] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.238043] node 0 deferred pages initialised in 40ms [ 0.243151] devtmpfs: initialized [ 0.245313] x86/mm: Memory block size: 128MB [ 0.249541] gcov: version magic: 0x41383552 [ 0.254028] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.257037] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.259622] pinctrl core: initialized pinctrl subsystem [ 0.262257] [ 0.262954] ************************************************************* [ 0.265014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.268084] ** ** [ 0.271015] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.274014] ** ** [ 0.277014] ** This means that this kernel is built to expose internal ** [ 0.280015] ** IOMMU data structures, which may compromise security on ** [ 0.282013] ** your system. ** [ 0.285483] ** ** [ 0.289020] ** If you see this message and you are not debugging the ** [ 0.292012] ** kernel, report this immediately to your vendor! ** [ 0.294016] ** ** [ 0.298012] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.301014] ************************************************************* [ 0.305844] NET: Registered protocol family 16 [ 0.309022] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.312074] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.314076] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.318151] cpuidle: using governor menu [ 0.322328] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.326605] PCI: Using configuration type 1 for base access [ 0.330164] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.339567] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.340017] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.344184] cryptd: max_cpu_qlen set to 1000 [ 0.348312] ACPI: Added _OSI(Module Device) [ 0.349000] ACPI: Added _OSI(Processor Device) [ 0.350016] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.352016] ACPI: Added _OSI(Processor Aggregator Device) [ 0.359140] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.366967] ACPI: Interpreter enabled [ 0.368060] ACPI: PM: (supports S0 S3 S4 S5) [ 0.370011] ACPI: Using IOAPIC for interrupt routing [ 0.372242] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.376991] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.391630] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.394048] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.397028] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.400209] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.408366] acpiphp: Slot [2] registered [ 0.409250] acpiphp: Slot [5] registered [ 0.411135] acpiphp: Slot [6] registered [ 0.412000] acpiphp: Slot [7] registered [ 0.412589] acpiphp: Slot [8] registered [ 0.414495] acpiphp: Slot [9] registered [ 0.416157] acpiphp: Slot [10] registered [ 0.418842] acpiphp: Slot [3] registered [ 0.420953] acpiphp: Slot [4] registered [ 0.422125] acpiphp: Slot [11] registered [ 0.424139] acpiphp: Slot [12] registered [ 0.426133] acpiphp: Slot [13] registered [ 0.427121] acpiphp: Slot [14] registered [ 0.430141] acpiphp: Slot [15] registered [ 0.432189] acpiphp: Slot [16] registered [ 0.434416] acpiphp: Slot [17] registered [ 0.436580] acpiphp: Slot [18] registered [ 0.439274] acpiphp: Slot [19] registered [ 0.440399] acpiphp: Slot [20] registered [ 0.442097] acpiphp: Slot [21] registered [ 0.444137] acpiphp: Slot [22] registered [ 0.446128] acpiphp: Slot [23] registered [ 0.447108] acpiphp: Slot [24] registered [ 0.449173] acpiphp: Slot [25] registered [ 0.450211] acpiphp: Slot [26] registered [ 0.452200] acpiphp: Slot [27] registered [ 0.454170] acpiphp: Slot [28] registered [ 0.456151] acpiphp: Slot [29] registered [ 0.457169] acpiphp: Slot [30] registered [ 0.460191] acpiphp: Slot [31] registered [ 0.463081] PCI host bridge to bus 0000:00 [ 0.464019] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.467028] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.469055] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.471032] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.474025] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.477029] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.479199] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.483483] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.487345] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.498536] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.504052] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.507092] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.510129] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.513019] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.516324] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.521158] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.523051] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.528012] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.533018] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.547020] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.550842] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.558014] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.567020] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.574018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.592023] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.603000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.610016] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.615019] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.632018] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.640000] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.649034] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.659021] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.679019] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.693699] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.715022] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.730019] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.747021] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.758961] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.768020] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.773021] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.790021] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.801366] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.806019] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.814020] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.830020] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.842845] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.844573] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.850048] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.853622] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.856231] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.861105] iommu: Default domain type: Passthrough [ 0.864473] SCSI subsystem initialized [ 0.866251] ACPI: bus type USB registered [ 0.867000] usbcore: registered new interface driver usbfs [ 0.869106] usbcore: registered new interface driver hub [ 0.871193] usbcore: registered new device driver usb [ 0.874146] pps_core: LinuxPPS API ver. 1 registered [ 0.876011] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.881086] PTP clock support registered [ 0.883497] EDAC MC: Ver: 3.0.0 [ 0.884000] PCI: Using ACPI for IRQ routing [ 0.886455] NetLabel: Initializing [ 0.889014] NetLabel: domain hash size = 128 [ 0.891011] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.893096] NetLabel: unlabeled traffic allowed by default [ 0.896488] vgaarb: loaded [ 0.900301] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.902012] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.909400] clocksource: Switched to clocksource kvm-clock [ 1.060774] VFS: Disk quotas dquot_6.6.0 [ 1.063401] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.066248] *** VALIDATE ramfs *** [ 1.067682] *** VALIDATE hugetlbfs *** [ 1.069918] pnp: PnP ACPI init [ 1.072946] pnp: PnP ACPI: found 6 devices [ 1.101691] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.107568] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.111983] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.114483] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.118293] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.122507] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.127794] NET: Registered protocol family 2 [ 1.130739] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.135499] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.139167] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.144420] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.147715] TCP: Hash tables configured (established 65536 bind 65536) [ 1.150747] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.153722] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.156653] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.159812] NET: Registered protocol family 1 [ 1.162203] RPC: Registered named UNIX socket transport module. [ 1.164706] RPC: Registered udp transport module. [ 1.166322] RPC: Registered tcp transport module. [ 1.170705] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.173587] NET: Registered protocol family 44 [ 1.176440] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.179524] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.182986] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.186461] PCI: CLS 0 bytes, default 64 [ 1.189253] Unpacking initramfs... [ 3.131544] debug: unmapping init [mem 0xffff93d77cc54000-0xffff93d77ffbffff] [ 3.138527] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.141045] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 3.145555] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.814984] Initialise system trusted keyrings [ 3.816135] Key type blacklist registered [ 3.875687] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.887627] zbud: loaded [ 3.892985] *** VALIDATE nfs *** [ 3.894288] *** VALIDATE nfs4 *** [ 3.896131] pstore: using deflate compression [ 3.900148] Platform Keyring initialized [ 4.018810] NET: Registered protocol family 38 [ 4.020675] Key type asymmetric registered [ 4.022501] Asymmetric key parser 'x509' registered [ 4.024660] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 4.028046] io scheduler mq-deadline registered [ 4.029592] io scheduler kyber registered [ 4.031515] io scheduler bfq registered [ 4.033468] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 4.037068] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.040618] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 4.044267] ACPI: Power Button [PWRF] [ 4.051371] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 4.061235] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 4.082965] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 4.089388] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 4.109555] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 4.196415] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.233801] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.238801] Non-volatile memory driver v1.3 [ 4.240481] Linux agpgart interface v0.103 [ 4.271694] virtio_blk virtio1: [vda] 134128 512-byte logical blocks (68.7 MB/65.5 MiB) [ 4.273984] vda: detected capacity change from 0 to 68673536 [ 4.287494] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 4.290934] vdb: detected capacity change from 0 to 1073741824 [ 4.325300] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 4.331529] vdc: detected capacity change from 0 to 2621440000 [ 4.358255] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 4.363413] vdd: detected capacity change from 0 to 2621440000 [ 4.391886] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.399791] vde: detected capacity change from 0 to 4294967296 [ 4.424609] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.428604] vdf: detected capacity change from 0 to 4294967296 [ 4.436899] libphy: Fixed MDIO Bus: probed [ 4.444844] usbcore: registered new interface driver usbserial_generic [ 4.448239] usbserial: USB Serial support registered for generic [ 4.451252] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 4.457236] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 4.459494] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 4.463089] mousedev: PS/2 mouse device common for all mice [ 4.467944] rtc_cmos 00:05: RTC can wake from S4 [ 4.473524] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 4.479483] rtc_cmos 00:05: registered as rtc0 [ 4.483295] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 4.487944] intel_pstate: CPU model not supported [ 4.488618] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 4.497560] hid: raw HID events driver (C) Jiri Kosina [ 4.500167] usbcore: registered new interface driver usbhid [ 4.503542] usbhid: USB HID core driver [ 4.505887] drop_monitor: Initializing network drop monitor service [ 4.509079] Initializing XFRM netlink socket [ 4.511886] NET: Registered protocol family 10 [ 4.516185] Segment Routing with IPv6 [ 4.516901] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 4.517828] NET: Registered protocol family 17 [ 4.518154] mpls_gso: MPLS GSO support [ 4.532241] RAS: Correctable Errors collector initialized. [ 4.534805] AVX version of gcm_enc/dec engaged. [ 4.536901] AES CTR mode by8 optimization enabled [ 4.757616] sched_clock: Marking stable (4757533140, 0)->(6262252744, -1504719604) [ 4.762242] registered taskstats version 1 [ 4.764608] Loading compiled-in X.509 certificates [ 4.767646] zswap: loaded using pool lzo/zbud [ 4.798843] Key type big_key registered [ 4.814339] Key type encrypted registered [ 4.816530] ima: No TPM chip found, activating TPM-bypass! [ 4.821181] ima: Allocated hash algorithm: sha1 [ 4.823573] ima: No architecture policies found [ 4.825934] evm: Initialising EVM extended attributes: [ 4.828247] evm: security.selinux [ 4.829797] evm: security.ima [ 4.831127] evm: security.capability [ 4.832205] evm: HMAC attrs: 0x1 [ 4.834383] rtc_cmos 00:05: setting system clock to 2026-04-11 00:09:16 UTC (1775866156) [ 4.844161] debug: unmapping init [mem 0xffffffffb3c03000-0xffffffffb3dfffff] [ 4.850245] debug: unmapping init [mem 0xffffffffb2982000-0xffffffffb2c58fff] [ 4.869489] Write protecting the kernel read-only data: 28672k [ 4.877925] debug: unmapping init [mem 0xffffffffb1003000-0xffffffffb11fffff] [ 4.883812] debug: unmapping init [mem 0xffffffffb1914000-0xffffffffb19fffff] [ 4.927826] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.938441] systemd[1]: Detected virtualization kvm. [ 4.940914] systemd[1]: Detected architecture x86-64. [ 4.943580] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.978797] systemd[1]: No hostname configured. [ 4.980686] systemd[1]: Set hostname to . [ 4.983342] random: systemd: uninitialized urandom read (16 bytes read) [ 4.986375] systemd[1]: Initializing machine ID from random generator. [ 5.245516] random: ln: uninitialized urandom read (6 bytes read) [ 5.425198] random: systemd: uninitialized urandom read (16 bytes read) [ 5.427636] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 5.438459] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.447284] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Journal Socket. [ OK ] Started Memstrack Anylazing Service. Starting Create list of required st…ce nodes for the current kernel... Starting Apply Kernel Variables... [ OK ] Reached target Swap. Starting Setup Virtual Console... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Sockets. [ OK ] Reached target Paths. [ OK ] Reached target Slices. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 7.681191] device-mapper: uevent: version 1.0.3 [ 7.683533] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook..[ 8.736949] virtio_net virtio0 ens2: renamed from eth0 . [ 8.784963] random: fast init done [ 9.374885] scsi host0: ata_piix [ 9.481131] scsi host1: ata_piix [ 9.482425] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 9.487786] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 14.472806] random: crng init done [ 14.504357] random: 7 urandom warning(s) missed due to ratelimiting [ 15.357368] dracut-initqueue[581]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 17.156511] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. Stopping udev Kernel Device Manager... [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Slices. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 19.183760] printk: systemd: 26 output lines suppressed due to ratelimiting [ 19.929904] SELinux: Disabled at runtime. [ 19.998538] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 20.008064] systemd[1]: Detected virtualization kvm. [ 20.010384] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 20.720506] systemd[1]: initrd-switch-root.service: Succeeded. [ 20.724519] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 20.747467] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 20.752425] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 20.756291] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 20.765709] systemd[1]: Starting Journal Service... Starting Journal Service... [ 20.770800] systemd[1]: Reached target rpc_pipefs.target. [ OK ] Reached target rpc_pipefs.target. Starting Remount Root and Kernel File Systems... [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Kernel Debug File System... [ OK ] Started Dispatch Password Requests to Console Directory Watch. Mounting Huge Pages File System... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped target Switch Root. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on Process Core Dump Socket. Activating swap /dev/disk/by-label/SWAP... Starting Apply Kernel Variables... [ OK ] Stopped target Initrd File Systems. [ OK ] Reached target RPC Port Mapper. [ 21.697342] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Apply Kernel Variables. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Flush Journal to Persistent Storage. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 23.282417] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 23.920408] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 24.004566] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 24.788485] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 25.091727] EDAC sbridge: Ver: 1.1.2 [ 28.836868] Key type dns_resolver registered [* ] A start job is running for Configur…-only root support (8s / no limit)[ 29.252371] NFS: Registering the id_resolver key type [ 29.254739] Key type id_resolver registered [ 29.256597] Key type id_legacy registered [** ] A start job is running for Configur…-only root support (8s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Reached target Basic System. Starting Login Service... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Started OpenSSH server daemon. Starting Hostname Service... [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg247-server login: [ 66.966182] libcfs: loading out-of-tree module taints kernel. [ 66.994342] Key type ._llcrypt registered [ 66.996759] Key type .llcrypt registered [ 67.053558] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 75.916634] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 76.783358] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 76.795827] alg: No test for adler32 (adler32-zlib) [ 77.889526] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 78.284204] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 79.927185] Key type lgssc registered [ 80.880538] Lustre: Echo OBD driver; http://www.lustre.org/ [ 90.209197] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 111.407599] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 117.612686] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 117.626633] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 118.766873] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 118.790628] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 118.833776] Lustre: lustre-MDT0000: new disk, initializing [ 118.879913] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 118.890120] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 120.981886] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 128.433716] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 128.503468] Lustre: 6482:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 128.529983] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 128.533716] Lustre: Skipped 1 previous similar message [ 128.582641] Lustre: lustre-MDT0001: new disk, initializing [ 128.619529] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 128.638311] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 128.644628] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 130.462662] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 133.250848] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 137.644023] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 137.762316] Lustre: lustre-OST0000: new disk, initializing [ 137.765222] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 137.792941] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 140.305193] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 146.575054] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 146.625019] Lustre: lustre-OST0001: new disk, initializing [ 146.627419] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 146.645141] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 146.935721] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 146.943288] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 146.949474] Lustre: Skipped 1 previous similar message [ 146.989306] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 146.989484] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 149.038444] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 156.250486] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 159.589718] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 166.977244] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing check_logdir /tmp/testlogs/ [ 169.800550] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing yml_node [ 172.707507] Lustre: DEBUG MARKER: Client: 2.17.52.3 [ 174.829597] Lustre: DEBUG MARKER: MDS: 2.17.52.3 [ 178.016287] Lustre: DEBUG MARKER: OSS: 2.17.52.3 [ 179.785600] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Fri Apr 10 20:12:09 EDT 2026 [ 200.517954] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 202.642724] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 221.152695] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 221.158126] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 221.171113] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 223.711773] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 223.713326] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 223.717033] Lustre: Skipped 2 previous similar messages [ 223.725879] Lustre: Skipped 2 previous similar messages [ 225.080807] Lustre: server umount lustre-MDT0000 complete [ 229.279858] LustreError: 6473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775866380 with bad export cookie 12165778912818217611 [ 229.283286] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 229.294864] LustreError: 6473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 233.952583] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 233.955921] LustreError: 6488:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 233.956101] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 233.956105] Lustre: Skipped 1 previous similar message [ 233.962242] Lustre: Skipped 1 previous similar message [ 233.990875] LustreError: 6488:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 234.976752] LustreError: 8902:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 235.006135] LustreError: 8902:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 236.023746] Lustre: server umount lustre-MDT0001 complete [ 239.708585] Lustre: server umount lustre-OST0000 complete [ 244.208843] Lustre: server umount lustre-OST0001 complete [ 249.232381] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 255.813703] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 265.673712] hrtimer: interrupt took 6623807 ns [ 281.543144] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 281.738232] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 281.773376] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 281.882859] Lustre: lustre-MDT0000: new disk, initializing [ 281.964871] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 281.996036] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 281.998916] Lustre: Skipped 1 previous similar message [ 285.448384] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 293.236577] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 293.292144] Lustre: 14944:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 293.323153] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 293.329803] Lustre: Skipped 1 previous similar message [ 293.375156] Lustre: lustre-MDT0001: new disk, initializing [ 293.450990] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 293.479193] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 293.492978] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 296.621812] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 302.703353] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 305.995955] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 311.072162] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 311.288830] Lustre: lustre-OST0000: new disk, initializing [ 311.292158] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 311.356625] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 312.708328] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 312.718124] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 312.829935] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 315.623894] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 322.297726] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 326.418263] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 326.628692] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 329.989587] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 330.152249] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 333.281635] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 333.285162] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 333.285914] LustreError: Skipped 1 previous similar message [ 333.286504] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 333.286508] Lustre: Skipped 3 previous similar messages [ 333.305944] Lustre: Skipped 1 previous similar message [ 338.404956] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 338.408760] Lustre: Skipped 2 previous similar messages [ 346.079338] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 346.234547] Lustre: server umount lustre-OST0000 complete [ 349.664403] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 349.670416] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 349.681910] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 349.684799] Lustre: Skipped 2 previous similar messages [ 355.511767] Lustre: server umount lustre-MDT0000 complete [ 358.493454] LustreError: 14939:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775866510 with bad export cookie 12165778912818219039 [ 358.500033] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 358.501505] LustreError: 14939:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 358.737744] Lustre: server umount lustre-MDT0001 complete [ 362.456378] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 20:15:12 (1775866512) [ 367.179390] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 367.494948] LustreError: 18807:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 367.547082] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 370.544706] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 372.706289] LustreError: 18808:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 377.542848] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 381.227710] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 385.446696] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 388.325185] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 392.764684] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 397.658876] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 401.908739] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 408.227146] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 413.666049] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 413.668121] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 413.670361] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 413.678632] Lustre: Skipped 3 previous similar messages [ 413.689886] Lustre: Skipped 4 previous similar messages [ 415.070850] Lustre: server umount lustre-MDT0000 complete [ 417.905087] LustreError: 18788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775866569 with bad export cookie 12165778912818219928 [ 417.911319] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 417.916576] LustreError: 18788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 418.236754] Lustre: server umount lustre-MDT0001 complete [ 431.469507] Lustre: server umount lustre-OST0000 complete [ 446.014755] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 452.782495] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 453.050769] LustreError: 22833:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 453.117555] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 453.121644] Lustre: Skipped 2 previous similar messages [ 456.091534] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 461.986808] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 465.348943] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 467.466439] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 472.425667] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 477.529899] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 484.682105] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 484.823313] Lustre: lustre-OST0001: new disk, initializing [ 484.828522] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 486.113152] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 486.128879] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 486.253213] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 490.106875] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 499.534163] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 503.531349] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 523.233311] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 523.239587] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 523.244775] Lustre: Skipped 3 previous similar messages [ 523.254043] Lustre: Skipped 3 previous similar messages [ 525.606522] Lustre: server umount lustre-MDT0000 complete [ 528.359958] LustreError: 22834:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 528.386240] LustreError: 22834:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 528.446818] LustreError: 22815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775866680 with bad export cookie 12165778912818220775 [ 528.452221] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 528.457870] LustreError: 22815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 528.743795] Lustre: server umount lustre-MDT0001 complete [ 542.860226] Lustre: server umount lustre-OST0000 complete [ 556.488867] Lustre: server umount lustre-OST0001 complete [ 569.711281] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 577.861310] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 578.255261] LustreError: 28084:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 582.420555] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 589.181387] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 589.522384] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 589.531566] Lustre: Skipped 4 previous similar messages [ 593.132799] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 595.652611] Lustre: 29198:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 600.848062] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 605.678973] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 611.604611] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 615.792176] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 621.931879] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 624.893938] Lustre: 31049:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 634.858022] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 634.864414] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 634.874751] Lustre: Skipped 3 previous similar messages [ 634.893915] Lustre: Skipped 3 previous similar messages [ 640.060265] Lustre: server umount lustre-MDT0000 complete [ 642.485789] LustreError: 29201:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775866794 with bad export cookie 12165778912818222070 [ 642.487482] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 642.494653] LustreError: 29201:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 642.748854] Lustre: server umount lustre-MDT0001 complete [ 655.814194] Lustre: server umount lustre-OST0000 complete [ 669.118870] Lustre: server umount lustre-OST0001 complete [ 675.468423] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 20:20:25 (1775866825) [ 694.294236] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 700.821634] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 701.107394] LustreError: 33834:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 701.127460] LustreError: 33834:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 704.273750] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 710.430598] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 713.506343] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 715.643951] Lustre: 34949:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 720.245258] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 725.104328] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 731.820827] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 736.783863] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 743.217418] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 745.523861] Lustre: 36797:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 756.706046] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 756.711369] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 760.938781] Lustre: server umount lustre-MDT0000 complete [ 763.624132] LustreError: 36123:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775866915 with bad export cookie 12165778912818223169 [ 763.626593] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 763.639934] LustreError: 36123:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 763.898651] Lustre: server umount lustre-MDT0001 complete [ 777.317062] Lustre: server umount lustre-OST0000 complete [ 790.485337] Lustre: server umount lustre-OST0001 complete [ 796.902290] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 20:22:27 (1775866947) [ 809.822269] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 817.411406] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 817.673921] LustreError: 38922:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 817.689177] LustreError: 38922:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 821.017895] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 827.467893] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 830.365984] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 832.282574] Lustre: 40034:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 837.379353] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 842.659451] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 848.773841] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 849.032128] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 849.034970] Lustre: Skipped 9 previous similar messages [ 853.252391] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 858.751331] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 866.566453] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 866.569677] Lustre: Skipped 1 previous similar message [ 868.834173] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 868.840092] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 868.842053] Lustre: Skipped 9 previous similar messages [ 874.627848] Lustre: server umount lustre-MDT0000 complete [ 877.908119] LustreError: 41940:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775867029 with bad export cookie 12165778912818224282 [ 877.911304] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 877.922092] LustreError: 41940:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 892.383319] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 892.548367] Lustre: server umount lustre-MDT0001 complete [ 899.295828] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 906.126936] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 912.054656] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 915.038490] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 918.326393] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 918.504295] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 923.956891] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 4 sec [ 927.261460] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 928.500638] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 932.832729] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 932.843762] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 932.862287] Lustre: Skipped 9 previous similar messages [ 937.950871] Lustre: server umount lustre-MDT0000 complete [ 940.812912] LustreError: 38902:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775867092 with bad export cookie 12165778912818225444 [ 940.819086] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 940.821251] LustreError: 38902:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 941.021714] Lustre: server umount lustre-MDT0001 complete [ 954.447552] Lustre: server umount lustre-OST0000 complete [ 967.856222] Lustre: server umount lustre-OST0001 complete [ 974.931115] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 20:25:24 (1775867124) [ 986.784331] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 994.376991] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 994.659971] LustreError: 46257:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 994.668706] LustreError: 46257:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 27 previous similar messages [ 998.675600] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1005.705441] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1009.738295] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1011.883858] Lustre: 47375:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1011.892399] Lustre: 47375:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message [ 1017.306876] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1021.523499] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1027.808241] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1032.952295] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1038.708377] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1047.018735] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1057.250434] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1061.119497] Lustre: server umount lustre-MDT0000 complete [ 1063.877163] LustreError: 49286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775867215 with bad export cookie 12165778912818226270 [ 1063.891908] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1064.177586] Lustre: server umount lustre-MDT0001 complete [ 1077.778846] Lustre: server umount lustre-OST0000 complete [ 1090.743633] Lustre: server umount lustre-OST0001 complete [ 1097.568384] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 20:27:27 (1775867247) [ 1099.839606] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1101.038985] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 20:27:31 (1775867251) [ 1108.938195] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 1114.316887] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 1128.868168] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1129.045450] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1129.099588] Lustre: lustre-MDT0000: new disk, initializing [ 1129.162453] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1132.163723] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1137.966210] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1142.649990] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1144.031210] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1144.041421] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1144.072425] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1147.534496] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1155.445811] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1159.493578] Lustre: DEBUG MARKER: create test files [ 1205.732484] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1205.746182] Lustre: Skipped 7 previous similar messages [ 1205.750494] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1205.754470] Lustre: Skipped 22 previous similar messages [ 1207.505600] Lustre: server umount lustre-OST0000 complete [ 1212.492944] Lustre: server umount lustre-MDT0000 complete [ 1223.564559] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 1226.381695] Key type lgssc unregistered [ 1226.650843] LNet: 54781:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1226.659180] LNetError: 54781:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1226.674686] LNet: Removed LNI 192.168.202.147@tcp [ 1227.687215] Key type .llcrypt unregistered [ 1227.689100] Key type ._llcrypt unregistered [ 1261.075369] Key type ._llcrypt registered [ 1261.077828] Key type .llcrypt registered [ 1261.169849] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 1262.143811] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1262.383243] alg: No test for adler32 (adler32-zlib) [ 1263.498793] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 1263.703815] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 1265.351834] Key type lgssc registered [ 1266.652605] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1274.530136] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1274.561214] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1276.087895] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1280.149433] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1285.897595] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1293.745445] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1294.206919] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1300.406423] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1301.383986] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1301.507532] Lustre: 57389:0:(osd_internal.h:1446:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1301.528062] Lustre: 57389:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1301.532528] Lustre: 57389:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1301.538081] Lustre: 57389:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/24/1, punch: 0/0/0, quota 1/3/0 [ 1301.546825] Lustre: 57389:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1301.552240] Lustre: 57389:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1306.769650] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1312.771915] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1317.976725] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1327.077209] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1327.092731] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1327.111888] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1332.194118] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1337.321596] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1339.359390] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1339.530733] Lustre: server umount lustre-OST0000 complete [ 1343.572687] Lustre: server umount lustre-MDT0000 complete [ 1353.684861] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 1356.325744] Key type lgssc unregistered [ 1356.657941] LNet: 58874:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1356.674126] LNetError: 58874:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1357.737208] LNet: Removed LNI 192.168.202.147@tcp [ 1358.288141] Key type .llcrypt unregistered [ 1358.289765] Key type ._llcrypt unregistered [ 1386.630402] Key type ._llcrypt registered [ 1386.636711] Key type .llcrypt registered [ 1386.754339] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 1388.065504] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1388.100241] alg: No test for adler32 (adler32-zlib) [ 1389.170693] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 1389.377929] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 1391.031225] Key type lgssc registered [ 1392.121978] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1399.988668] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1400.036974] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1401.824947] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1407.186370] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1414.413560] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1423.494333] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1423.976243] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1427.071497] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1427.233841] Lustre: 61561:0:(osd_internal.h:1446:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 514 < left 544, rollback = 9 [ 1427.257063] Lustre: 61561:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/1, destroy: 0/0/0 [ 1427.264747] Lustre: 61561:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1427.273250] Lustre: 61561:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/24/1, punch: 0/0/0, quota 1/3/0 [ 1427.280281] Lustre: 61561:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1427.287025] Lustre: 61561:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1430.661239] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1437.345289] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1442.787608] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1453.025799] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1453.027658] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1453.052329] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1457.449567] Lustre: server umount lustre-OST0000 complete [ 1461.898451] Lustre: server umount lustre-MDT0000 complete [ 1474.768033] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 1477.968395] Key type lgssc unregistered [ 1478.483723] LNet: 62990:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1478.496825] LNetError: 62990:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1478.512243] LNet: Removed LNI 192.168.202.147@tcp [ 1479.914595] Key type .llcrypt unregistered [ 1479.916766] Key type ._llcrypt unregistered [ 1502.023966] Key type ._llcrypt registered [ 1502.026205] Key type .llcrypt registered [ 1502.119242] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 1518.157527] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 1519.511593] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1519.552189] alg: No test for adler32 (adler32-zlib) [ 1520.535456] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 1520.723038] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 1522.383149] Key type lgssc registered [ 1523.260700] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1559.662812] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1559.714611] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1560.988251] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1561.040887] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1561.134416] Lustre: lustre-MDT0000: new disk, initializing [ 1561.194365] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1561.211692] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1565.578642] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1575.577442] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1575.732951] Lustre: 66108:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1575.861684] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1575.875691] Lustre: Skipped 1 previous similar message [ 1576.011900] Lustre: lustre-MDT0001: new disk, initializing [ 1576.156508] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1576.224076] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1576.243506] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1580.774781] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1588.605973] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1592.945747] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1601.223043] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1601.573407] Lustre: lustre-OST0000: new disk, initializing [ 1601.577443] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1601.666709] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1607.757142] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1611.355492] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1611.371450] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1611.482513] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1615.390560] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1619.635233] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1619.898458] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1624.909786] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1625.158077] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1632.224615] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1632.231111] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1632.232914] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1632.261925] Lustre: Skipped 1 previous similar message [ 1633.698779] Lustre: server umount lustre-OST0000 complete [ 1637.857625] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1637.864363] LustreError: Skipped 1 previous similar message [ 1637.866762] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1637.877697] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1637.880201] Lustre: Skipped 1 previous similar message [ 1642.471308] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1642.482166] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1647.584039] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1647.594812] Lustre: Skipped 2 previous similar messages [ 1652.191269] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1652.379520] Lustre: server umount lustre-MDT0000 complete [ 1656.100874] LustreError: 66102:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775867807 with bad export cookie 17821564679607625537 [ 1656.117588] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1656.358923] Lustre: server umount lustre-MDT0001 complete [ 1665.684658] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 20:36:55 (1775867815) [ 1677.214661] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 1724.065796] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 1733.458322] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 1770.073988] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1770.333818] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1770.371558] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1770.447299] Lustre: lustre-MDT0000: new disk, initializing [ 1770.526114] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1770.538603] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1775.068712] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1786.545468] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1786.692176] Lustre: 73677:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1786.787279] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1786.801039] Lustre: Skipped 1 previous similar message [ 1786.929950] Lustre: lustre-MDT0001: new disk, initializing [ 1787.082839] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1787.118249] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1787.128065] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1791.786549] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1799.987184] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1803.847320] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1811.052638] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1811.318574] Lustre: lustre-OST0000: new disk, initializing [ 1811.324583] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1811.416148] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1817.493716] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1821.306817] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1821.323556] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1821.505564] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1826.636900] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1832.161380] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1832.495278] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1837.137682] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1837.371859] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1842.144372] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1842.161147] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1842.166665] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1842.186155] Lustre: Skipped 1 previous similar message [ 1846.384502] Lustre: server umount lustre-OST0000 complete [ 1852.385482] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1852.397792] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1852.406272] Lustre: Skipped 2 previous similar messages [ 1866.210387] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1866.720761] LustreError: 73682:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1866.738558] LustreError: 73682:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1866.781603] Lustre: server umount lustre-MDT0000 complete [ 1870.929213] LustreError: 74454:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775868022 with bad export cookie 17821564679607626419 [ 1870.936862] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1870.960469] LustreError: 74454:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 1871.390740] Lustre: server umount lustre-MDT0001 complete [ 1882.996511] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 20:40:32 (1775868032) [ 1892.558996] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1893.109963] LustreError: 77687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1893.236754] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1898.477965] LustreError: 77688:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1899.929458] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1902.563721] LustreError: 77687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1907.716317] LustreError: 77688:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1910.655042] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1918.674704] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1925.816581] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1930.107775] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1937.400490] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1937.958951] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1937.964734] Lustre: Skipped 1 previous similar message [ 1946.605830] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 1953.332948] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1957.109488] Lustre: 80023:0:(genops.c:1793:obd_export_evict_by_uuid()) MGS: evicting 0be7aab4-9a8d-428c-80ab-0a4556b45bb6 at adminstrative request [ 1961.450623] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1961.459425] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1971.684943] Lustre: MGS: Client 0be7aab4-9a8d-428c-80ab-0a4556b45bb6 (at 0@lo) reconnecting [ 1971.688987] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xf752eaa745a92e25 to 0xf752eaa745a930be [ 1971.695580] Lustre: MGC192.168.202.147@tcp: Connection restored to 0@lo (at 0@lo) [ 1995.598867] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1995.794177] Lustre: lustre-OST0001: new disk, initializing [ 1995.799041] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2003.119542] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2003.615379] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2003.632865] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2003.784783] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2011.873493] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2019.300713] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2019.304483] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2019.308503] Lustre: Skipped 1 previous similar message [ 2019.318157] LustreError: Skipped 2 previous similar messages [ 2019.321508] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2019.338458] Lustre: Skipped 5 previous similar messages [ 2029.023644] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2029.158073] Lustre: server umount lustre-OST0001 complete [ 2029.554178] LustreError: 79284:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2029.568583] LustreError: 79284:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2034.147298] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2040.646815] Lustre: server umount lustre-OST0000 complete [ 2044.385647] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2044.390943] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2044.410817] Lustre: Skipped 3 previous similar messages [ 2050.543525] Lustre: server umount lustre-MDT0000 complete [ 2054.982336] LustreError: 77667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775868206 with bad export cookie 17821564679607627966 [ 2054.992354] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2055.000202] LustreError: 77667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2055.716561] Lustre: server umount lustre-MDT0001 complete [ 2063.837160] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 20:43:33 (1775868213) [ 2065.440740] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2067.185671] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 20:43:37 (1775868217) [ 2069.114219] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2070.598490] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 20:43:40 (1775868220) [ 2072.507884] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2074.162709] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 20:43:44 (1775868224) [ 2075.446555] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2077.234219] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 20:43:47 (1775868227) [ 2078.658056] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2083.953468] loop: module loaded [ 2083.987255] loop0: detected capacity change from 0 to 4294967296 [ 2084.045951] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2085.962174] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2088.692857] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2092.687533] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2121.938392] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2121.994992] LustreError: 84418:0:(obd_config.c:843:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2122.000235] LustreError: 84418:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2122.005341] LustreError: 84418:0:(tgt_mount.c:2513:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2122.011732] LustreError: 84418:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2142.830748] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 2153.095429] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 2187.912590] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2188.131455] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2188.154356] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2188.205882] Lustre: lustre-MDT0000: new disk, initializing [ 2188.266597] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2188.269802] Lustre: Skipped 1 previous similar message [ 2188.284248] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2192.574842] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2202.428782] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2202.592363] Lustre: 87249:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2202.889991] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2207.178759] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2214.786430] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2219.326557] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2227.078298] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2233.123278] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2233.473538] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2233.625978] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2241.386722] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2245.641909] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2245.839499] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2250.139354] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2250.373555] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2254.306894] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2254.308389] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2254.328891] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2254.340086] Lustre: Skipped 2 previous similar messages [ 2254.354755] Lustre: Skipped 10 previous similar messages [ 2259.108097] Lustre: server umount lustre-OST0000 complete [ 2272.170465] Lustre: server umount lustre-MDT0000 complete [ 2274.786871] LustreError: 89349:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2274.805022] LustreError: 89349:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 2276.828638] LustreError: 87241:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775868428 with bad export cookie 17821564679607628589 [ 2276.834108] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2276.843789] LustreError: 87241:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2277.666038] Lustre: server umount lustre-MDT0001 complete [ 2288.334573] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 20:47:18 (1775868438) [ 2294.465310] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2299.391446] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2307.706118] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2312.844799] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2319.870197] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2323.347654] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2332.399870] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2332.657063] LustreError: 92854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2332.687381] LustreError: 92854:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2332.928463] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2332.935755] Lustre: Skipped 4 previous similar messages [ 2339.949433] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2345.781541] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2350.524489] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2350.746888] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2354.986548] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2355.184979] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2362.019689] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2362.265361] Lustre: lustre-OST0001: new disk, initializing [ 2362.275831] Lustre: Skipped 2 previous similar messages [ 2362.280328] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2362.293313] Lustre: Skipped 3 previous similar messages [ 2370.260453] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2371.287075] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2371.301991] Lustre: Skipped 2 previous similar messages [ 2371.313294] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2371.512249] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2379.873613] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2385.809903] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2386.034254] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2391.595724] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2391.819561] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2412.507422] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2439.001066] Lustre: Failing over lustre-MDT0000 [ 2439.738682] Lustre: server umount lustre-MDT0000 complete [ 2440.238949] LustreError: 94791:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2441.197717] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2441.206233] LustreError: Skipped 2 previous similar messages [ 2441.220199] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2441.230592] Lustre: Skipped 2 previous similar messages [ 2459.615135] Lustre: 64334:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775868594/real 1775868594] req@0000000040e4019d x1862132220311552/t0(0) o400->MGC192.168.202.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1775868610 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2459.665457] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2468.176242] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2468.179878] LDISKFS-fs (dm-0): recovery complete [ 2468.188696] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2469.865661] LustreError: 64332:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@00000000f7cdfc2a x1862132220320640/t0(0) o250->MGC192.168.202.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2470.430222] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2470.905893] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2470.906335] Lustre: 91253:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2475.507042] Lustre: 91258:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2475.546250] Lustre: 91258:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 1 previous similar message [ 2475.553256] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2475.729900] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2476.088488] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2476.469650] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2476.486732] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 2476.815527] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2476.825676] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 2476.840982] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2476.870032] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 7 previous similar messages [ 2477.519967] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2477.528132] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 2 previous similar messages [ 2477.875820] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2477.895698] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 2 previous similar messages [ 2478.532789] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2478.913868] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2478.925432] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 5 previous similar messages [ 2479.589756] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2479.600585] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 5 previous similar messages [ 2479.958383] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2479.985961] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 5 previous similar messages [ 2482.979530] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2482.997854] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 11 previous similar messages [ 2483.643974] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2483.654729] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 11 previous similar messages [ 2483.983397] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2483.988056] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 11 previous similar messages [ 2491.112168] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2491.133045] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 24 previous similar messages [ 2491.805246] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2491.834948] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 24 previous similar messages [ 2492.176098] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2492.189104] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 24 previous similar messages [ 2507.137493] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2507.163095] Lustre: 96966:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 49 previous similar messages [ 2507.814838] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2507.825799] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 49 previous similar messages [ 2508.455304] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2508.466344] LustreError: 96966:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 50 previous similar messages [ 2530.082499] Lustre: 96966:0:(ldlm_lib.c:2377:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2530.100722] Lustre: 96966:0:(ldlm_lib.c:2387:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2530.113986] Lustre: 96966:0:(genops.c:1620:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client bfa3d5c2-b5f8-4907-9fd2-cf48a1990726@192.168.202.47@tcp [ 2530.138608] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2530.155700] Lustre: 96966:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@00000000b6e6aa07 x1862132203325568/t0(8589934765) o101->bfa3d5c2-b5f8-4907-9fd2-cf48a1990726@192.168.202.47@tcp:727/0 lens 592/0 e 0 to 0 dl 1775868692 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2530.222263] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2530.240404] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2530.242126] Lustre: lustre-MDT0000: Denying connection for new client bfa3d5c2-b5f8-4907-9fd2-cf48a1990726 (at 192.168.202.47@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2530.303559] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2530.306948] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2530.315759] Lustre: Skipped 2 previous similar messages [ 2530.385743] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:44 to 0x2c0000401:545) [ 2530.385942] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:76 to 0x280000401:577) [ 2546.157415] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2546.173203] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2546.175960] Lustre: Skipped 4 previous similar messages [ 2549.941747] Lustre: server umount lustre-OST0000 complete [ 2560.057849] Lustre: server umount lustre-OST0001 complete [ 2570.894495] Lustre: server umount lustre-MDT0000 complete [ 2572.780175] LustreError: 91253:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2572.821497] LustreError: 91253:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 47 previous similar messages [ 2575.021405] LustreError: 91238:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775868726 with bad export cookie 17821564679607679801 [ 2575.032268] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2575.038696] LustreError: 91238:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2575.702812] Lustre: server umount lustre-MDT0001 complete [ 2585.973804] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 20:52:15 (1775868735) [ 2593.061755] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2593.067510] Lustre: *** cfs_fail_loc=197, val=0*** [ 2608.544211] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2613.663465] LustreError: 98927:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.147@tcp: failed processing log, type 4: rc = -110 [ 2618.834621] Lustre: *** cfs_fail_loc=197, val=0*** [ 2618.839743] Lustre: Skipped 65 previous similar messages [ 2639.391298] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2639.398252] Lustre: Skipped 2 previous similar messages [ 2646.604952] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2652.858354] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2655.021227] Lustre: server umount lustre-OST0000 complete [ 2664.395207] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 20:53:34 (1775868814) [ 2685.753861] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2690.194580] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2697.669475] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2701.669925] LustreError: 100465:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2701.677953] LustreError: 100465:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2701.687815] LustreError: 100465:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 16, retries 0, failed: rc = -5 [ 2701.941951] Lustre: server umount lustre-MDT0000 complete [ 2734.567157] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 2746.418692] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 2783.219897] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2783.653940] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2783.688188] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2783.822302] Lustre: lustre-MDT0000: new disk, initializing [ 2783.975927] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2788.636599] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2801.973962] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2802.196925] Lustre: 104493:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2802.930086] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2809.459586] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2820.208534] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2826.315100] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2833.994836] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2842.110322] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 2842.909767] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2851.313202] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2856.959674] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2857.374159] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2863.116398] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2863.361568] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2868.704809] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2868.707105] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2868.725363] LustreError: Skipped 4 previous similar messages [ 2868.728230] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2868.741517] Lustre: Skipped 10 previous similar messages [ 2868.771993] Lustre: Skipped 10 previous similar messages [ 2871.728459] Lustre: server umount lustre-OST0000 complete [ 2881.416734] Lustre: server umount lustre-MDT0000 complete [ 2884.068758] LustreError: 106472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2884.089051] LustreError: 106472:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 2885.861465] LustreError: 104485:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775869037 with bad export cookie 17821564679607690329 [ 2885.863272] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2885.874237] LustreError: 104485:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2886.746478] Lustre: server umount lustre-MDT0001 complete [ 2895.189123] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 20:57:25 (1775869045) [ 2906.594208] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 2909.722939] Key type lgssc unregistered [ 2910.156324] LNet: 108561:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2910.181628] LNetError: 108561:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2910.203109] LNet: Removed LNI 192.168.202.147@tcp [ 2911.333917] Key type .llcrypt unregistered [ 2911.338457] Key type ._llcrypt unregistered [ 2934.684271] Key type ._llcrypt registered [ 2934.690317] Key type .llcrypt registered [ 2934.815509] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 2953.712927] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 2954.713750] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2954.831624] alg: No test for adler32 (adler32-zlib) [ 2955.902594] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 2956.079960] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 2957.863526] Key type lgssc registered [ 2959.025676] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2999.962719] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2999.987104] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3001.443084] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3001.506235] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3001.638766] Lustre: lustre-MDT0000: new disk, initializing [ 3001.811261] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3001.833315] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3006.806252] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3017.205680] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3017.655391] Lustre: lustre-OST0000: new disk, initializing [ 3017.674149] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3017.684227] Lustre: Skipped 1 previous similar message [ 3017.759638] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3025.437505] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3027.059456] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3027.081914] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3027.128111] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3036.868428] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3037.031484] Lustre: lustre-OST0001: new disk, initializing [ 3037.041408] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3037.123548] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3043.679500] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3044.509465] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3044.519583] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3044.546403] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3055.073294] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3055.089189] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3055.089500] Lustre: Skipped 1 previous similar message [ 3055.121623] Lustre: Skipped 1 previous similar message [ 3058.915550] Lustre: server umount lustre-MDT0000 complete [ 3065.797887] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3071.307762] LustreError: 113533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775869222 with bad export cookie 6104459537851075566 [ 3071.324612] LustreError: 113533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3071.329478] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3071.418512] Lustre: server umount lustre-OST0000 complete [ 3075.970383] Lustre: server umount lustre-OST0001 complete [ 3086.652826] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 21:00:36 (1775869236) [ 3097.269819] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 3123.055638] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 21:01:12 (1775869272) [ 3160.586151] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 3170.283784] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 3205.990122] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3206.233196] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3206.259302] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3206.326460] Lustre: lustre-MDT0000: new disk, initializing [ 3206.420366] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3206.443390] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3211.356051] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3220.372977] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3220.471853] Lustre: 120234:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3220.511741] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3220.515107] Lustre: Skipped 1 previous similar message [ 3220.570262] Lustre: lustre-MDT0001: new disk, initializing [ 3220.667069] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3220.705963] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3220.727626] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3224.188700] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3230.286381] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3233.488944] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3239.007940] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3239.201847] Lustre: lustre-OST0000: new disk, initializing [ 3239.207464] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3239.271463] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3244.096288] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3247.685118] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3247.697538] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3247.816526] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3250.563961] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3254.204619] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3254.421647] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3258.290932] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3258.493421] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3263.462242] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3263.468343] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3263.476664] LustreError: Skipped 1 previous similar message [ 3263.481396] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3263.491483] Lustre: Skipped 1 previous similar message [ 3263.511736] Lustre: Skipped 1 previous similar message [ 3266.205520] Lustre: server umount lustre-OST0000 complete [ 3272.161247] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3272.174189] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3272.184420] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3275.504506] Lustre: server umount lustre-MDT0000 complete [ 3279.411513] LustreError: 120227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775869431 with bad export cookie 6104459537851076791 [ 3279.414346] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3279.433664] LustreError: 120227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3279.913661] Lustre: server umount lustre-MDT0001 complete [ 3287.528938] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 21:03:57 (1775869437) [ 3293.518143] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3293.973126] LustreError: 124238:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3293.989542] LustreError: 124238:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3294.071179] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3297.980526] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3299.296259] LustreError: 124239:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3299.311236] LustreError: 124239:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3303.399463] LustreError: 124238:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3305.220918] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3309.013685] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3313.761912] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3317.133363] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3323.291799] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3328.425149] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3333.419654] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3343.040667] Lustre: *** cfs_fail_loc=159, val=0*** [ 3358.773657] Lustre: lustre-MDT0000: Client 800aeda4-0592-4b4d-b1a7-dfb246345951 (at 192.168.202.47@tcp) reconnecting [ 3360.277233] Lustre: *** cfs_fail_loc=159, val=0*** [ 3360.288895] Lustre: Skipped 5 previous similar messages [ 3376.675043] Lustre: lustre-MDT0000: Client 800aeda4-0592-4b4d-b1a7-dfb246345951 (at 192.168.202.47@tcp) reconnecting [ 3382.240716] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3382.248919] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3382.264985] Lustre: Skipped 1 previous similar message [ 3382.269995] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3382.275067] Lustre: Skipped 2 previous similar messages [ 3385.313723] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3386.587287] Lustre: server umount lustre-OST0000 complete [ 3390.433709] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3390.436522] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3390.447435] Lustre: Skipped 2 previous similar messages [ 3390.464580] Lustre: Skipped 3 previous similar messages [ 3400.672411] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3400.678616] Lustre: Skipped 2 previous similar messages [ 3404.255207] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3404.408164] Lustre: server umount lustre-MDT0000 complete [ 3405.796599] LustreError: 124949:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3405.814875] LustreError: 124949:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3407.409060] LustreError: 124220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775869559 with bad export cookie 6104459537851077673 [ 3407.411843] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3407.417374] LustreError: 124220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3407.796411] Lustre: server umount lustre-MDT0001 complete [ 3416.510935] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 3418.924692] Key type lgssc unregistered [ 3419.172220] LNet: 127658:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3419.196439] LNetError: 127658:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3420.273166] LNet: Removed LNI 192.168.202.147@tcp [ 3420.993662] Key type .llcrypt unregistered [ 3420.998140] Key type ._llcrypt unregistered [ 3439.317167] Key type ._llcrypt registered [ 3439.319201] Key type .llcrypt registered [ 3439.404957] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 3440.204717] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3440.353231] alg: No test for adler32 (adler32-zlib) [ 3441.298984] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 3441.465688] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 3443.111845] Key type lgssc registered [ 3444.100615] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3450.702240] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3450.729836] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3452.199793] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3458.834945] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3461.604499] LustreError: 129036:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3461.684550] LustreError: 129036:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3466.722476] LustreError: 129037:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3471.845985] LustreError: 129036:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3475.866346] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3476.397285] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3483.933832] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3494.367340] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3499.102134] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3507.245911] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3507.648056] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3514.171616] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3519.953968] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3523.065693] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3535.189779] Lustre: *** cfs_fail_loc=159, val=0*** [ 3550.766323] Lustre: lustre-MDT0000: Client 4ebef59c-1051-488e-9e93-936006b34808 (at 192.168.202.47@tcp) reconnecting [ 3553.834657] Lustre: *** cfs_fail_loc=159, val=0*** [ 3570.244306] Lustre: lustre-MDT0001: Client 4ebef59c-1051-488e-9e93-936006b34808 (at 192.168.202.47@tcp) reconnecting [ 3572.083636] Lustre: *** cfs_fail_loc=159, val=0*** [ 3572.090232] Lustre: Skipped 3 previous similar messages [ 3588.739278] Lustre: lustre-MDT0001: Client 4ebef59c-1051-488e-9e93-936006b34808 (at 192.168.202.47@tcp) reconnecting [ 3593.803205] Lustre: 131735:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3596.701315] Lustre: *** cfs_fail_loc=159, val=0*** [ 3596.712372] Lustre: Skipped 4 previous similar messages [ 3613.209471] Lustre: lustre-MDT0000: Client 3dbf0a45-e48b-479d-8de1-f22ff1034413 (at 192.168.202.47@tcp) reconnecting [ 3614.948080] Lustre: *** cfs_fail_loc=159, val=0*** [ 3614.958992] Lustre: Skipped 14 previous similar messages [ 3631.178405] Lustre: lustre-MDT0000: Client 3dbf0a45-e48b-479d-8de1-f22ff1034413 (at 192.168.202.47@tcp) reconnecting [ 3633.423436] Lustre: 132033:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3654.116478] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3654.123391] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3654.139493] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3654.783318] Lustre: server umount lustre-OST0000 complete [ 3660.771831] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3660.779779] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3660.796665] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3666.409237] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3666.414710] Lustre: Skipped 3 previous similar messages [ 3669.570204] Lustre: server umount lustre-MDT0000 complete [ 3670.497318] LustreError: 131396:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3670.511581] LustreError: 131396:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3673.323177] LustreError: 129016:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775869824 with bad export cookie 15884276095392486885 [ 3673.340374] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3673.340900] LustreError: 129016:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3673.680210] Lustre: server umount lustre-MDT0001 complete [ 3686.187855] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 3689.524046] Key type lgssc unregistered [ 3689.761145] LNet: 133097:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3689.769462] LNetError: 133097:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3689.782455] LNet: Removed LNI 192.168.202.147@tcp [ 3690.918480] Key type .llcrypt unregistered [ 3690.921140] Key type ._llcrypt unregistered [ 3720.317230] Key type ._llcrypt registered [ 3720.319613] Key type .llcrypt registered [ 3720.445694] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 3721.617691] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3721.652298] alg: No test for adler32 (adler32-zlib) [ 3722.796720] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 3723.157702] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 3724.887273] Key type lgssc registered [ 3726.737156] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3738.538644] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3738.560636] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3740.230908] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3745.870919] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3749.356468] LustreError: 134498:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3749.387236] LustreError: 134498:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3754.466063] LustreError: 134497:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3757.258740] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3757.850549] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3762.928550] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3771.392376] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3778.222866] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3786.606096] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3787.239159] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3794.107907] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3800.017114] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3802.610532] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3809.803556] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3817.181660] Lustre: 136767:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3822.139452] Lustre: 136816:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3824.551300] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3825.550610] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3829.755849] Lustre: 136963:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3830.950078] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3831.789698] Lustre: 137072:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3838.434069] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3838.451075] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3838.480308] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3840.480858] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3840.483995] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3842.198829] Lustre: server umount lustre-OST0000 complete [ 3850.208395] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3850.221304] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3850.250077] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3850.259893] Lustre: Skipped 1 previous similar message [ 3852.769929] Lustre: server umount lustre-MDT0000 complete [ 3855.840558] LustreError: 134493:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3855.877674] LustreError: 134493:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3856.773632] LustreError: 134479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775870008 with bad export cookie 2849157669405242140 [ 3856.777725] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3856.795422] LustreError: 134479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3857.165411] Lustre: server umount lustre-MDT0001 complete [ 3868.598648] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 3872.006985] Key type lgssc unregistered [ 3872.423762] LNet: 138112:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3872.430973] LNetError: 138112:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3872.444703] LNet: Removed LNI 192.168.202.147@tcp [ 3873.399958] Key type .llcrypt unregistered [ 3873.404556] Key type ._llcrypt unregistered [ 3901.971055] Key type ._llcrypt registered [ 3901.976413] Key type .llcrypt registered [ 3902.140547] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 3903.428218] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3903.524187] alg: No test for adler32 (adler32-zlib) [ 3904.845765] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 3905.164708] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 3906.856217] Key type lgssc registered [ 3908.674330] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3919.026603] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3919.066083] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3920.869100] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3925.901881] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3931.112224] LustreError: 139510:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3931.152198] LustreError: 139510:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3936.008259] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3936.225240] LustreError: 139511:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3936.460119] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3942.355676] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3948.025140] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3952.596956] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3961.176918] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3961.321749] LustreError: 141110:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3961.569246] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3965.687356] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3965.701811] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3968.646771] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 3975.332316] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3981.620903] Lustre: *** cfs_fail_loc=159, val=0*** [ 3997.249177] Lustre: lustre-MDT0000: Client 918691d3-fddc-4ccb-9414-a5a77552b6d4 (at 192.168.202.47@tcp) reconnecting [ 4017.120119] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4017.125902] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4017.140059] LustreError: Skipped 1 previous similar message [ 4017.167488] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4017.189394] Lustre: Skipped 1 previous similar message [ 4021.911634] Lustre: server umount lustre-OST0000 complete [ 4027.362382] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4027.364126] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4027.391763] Lustre: Skipped 2 previous similar messages [ 4032.500926] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4032.525308] Lustre: Skipped 2 previous similar messages [ 4032.726553] Lustre: server umount lustre-MDT0000 complete [ 4036.640806] LustreError: 139510:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4036.666582] LustreError: 139510:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4037.323194] LustreError: 141790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775870188 with bad export cookie 7364228087848290457 [ 4037.332068] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4037.348162] LustreError: 141790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4038.225660] Lustre: server umount lustre-MDT0001 complete [ 4051.587706] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 4055.016914] Key type lgssc unregistered [ 4055.297945] LNet: 142826:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4055.307729] LNetError: 142826:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4055.330126] LNet: Removed LNI 192.168.202.147@tcp [ 4056.375822] Key type .llcrypt unregistered [ 4056.381233] Key type ._llcrypt unregistered [ 4083.980207] Key type ._llcrypt registered [ 4083.981746] Key type .llcrypt registered [ 4084.065812] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 4085.365900] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4085.444620] alg: No test for adler32 (adler32-zlib) [ 4086.766937] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 4087.293549] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 4089.039866] Key type lgssc registered [ 4090.140118] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4098.980703] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4099.003298] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4100.444343] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4105.528635] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4110.820240] LustreError: 144225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4110.850375] LustreError: 144225:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4115.349468] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4115.892925] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4121.285944] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4127.354224] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4132.438632] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4142.537893] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4143.039057] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4146.108799] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4150.439177] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4157.534665] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4160.443862] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4182.754639] Lustre: lustre-MDT0001: evicting acba92b5-626e-4db6-abc1-f907c3d8a434 (at 192.168.202.47@tcp) by administrative request [ 4182.761753] Lustre: Skipped 1 previous similar message [ 4216.815142] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4216.835243] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4216.843386] Lustre: Skipped 1 previous similar message [ 4216.843927] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4216.861630] Lustre: Skipped 1 previous similar message [ 4219.399269] Lustre: server umount lustre-OST0000 complete [ 4227.044735] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4227.046283] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4227.064931] Lustre: Skipped 1 previous similar message [ 4227.098155] Lustre: Skipped 1 previous similar message [ 4230.552051] Lustre: server umount lustre-MDT0000 complete [ 4232.161103] LustreError: 144225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4232.200219] LustreError: 144225:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4235.688206] LustreError: 144204:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775870387 with bad export cookie 2904412967228035579 [ 4235.690448] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4235.710168] LustreError: 144204:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4236.416488] Lustre: server umount lustre-MDT0001 complete [ 4250.581223] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 4254.264798] Key type lgssc unregistered [ 4254.677889] LNet: 147944:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4254.699618] LNetError: 147944:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4254.730380] LNet: Removed LNI 192.168.202.147@tcp [ 4255.612837] Key type .llcrypt unregistered [ 4255.619496] Key type ._llcrypt unregistered [ 4347.111239] Key type ._llcrypt registered [ 4347.113429] Key type .llcrypt registered [ 4347.231607] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 4348.256465] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4348.465991] alg: No test for adler32 (adler32-zlib) [ 4349.835471] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 4350.257697] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 4352.016492] Key type lgssc registered [ 4353.499776] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4362.390733] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4362.406356] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4364.145550] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4369.289793] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4373.484354] LustreError: 150422:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4373.521892] LustreError: 150422:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4378.597414] LustreError: 150421:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4378.641971] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4379.150089] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4385.437421] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4391.998635] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4396.368898] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4404.562720] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4404.730346] LustreError: 152023:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4404.930640] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4410.057146] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4410.252310] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4413.220716] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4418.739945] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4430.821706] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4430.823491] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4430.835536] LustreError: Skipped 1 previous similar message [ 4430.841460] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4435.312181] Lustre: server umount lustre-OST0000 complete [ 4440.728517] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4440.764836] Lustre: Skipped 1 previous similar message [ 4440.770975] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4440.781871] Lustre: Skipped 1 previous similar message [ 4445.668130] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4445.679617] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4445.698783] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4451.296476] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4451.309429] Lustre: Skipped 3 previous similar messages [ 4455.391403] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4455.703449] Lustre: server umount lustre-MDT0000 complete [ 4456.416650] LustreError: 150422:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4456.435382] LustreError: 150422:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4459.823656] LustreError: 150402:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775870611 with bad export cookie 14433274227499770432 [ 4459.831666] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4459.839993] LustreError: 150402:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4460.259911] Lustre: server umount lustre-MDT0001 complete [ 4472.446243] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 4476.567969] Key type lgssc unregistered [ 4477.103718] LNet: 153613:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4477.126568] LNetError: 153613:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4477.176112] LNet: Removed LNI 192.168.202.147@tcp [ 4478.080557] Key type .llcrypt unregistered [ 4478.082522] Key type ._llcrypt unregistered [ 4510.031521] Key type ._llcrypt registered [ 4510.034348] Key type .llcrypt registered [ 4510.171778] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 4511.336576] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4511.419126] alg: No test for adler32 (adler32-zlib) [ 4512.715786] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 4513.006601] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 4514.663231] Key type lgssc registered [ 4516.356800] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4535.300238] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 21:24:44 (1775870684) [ 4555.861066] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 4567.577844] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 4607.475296] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4607.514981] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4608.802827] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4608.830666] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4608.918079] Lustre: lustre-MDT0000: new disk, initializing [ 4609.066895] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4609.112312] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4613.318639] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4624.537412] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4624.727058] Lustre: 157831:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4624.843698] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4624.848889] Lustre: Skipped 1 previous similar message [ 4624.949589] Lustre: lustre-MDT0001: new disk, initializing [ 4625.123148] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4625.187175] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4625.196691] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4630.662475] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4639.619993] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4644.486946] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4652.810295] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4653.250440] Lustre: lustre-OST0000: new disk, initializing [ 4653.256483] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4653.398036] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4659.213359] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4661.368399] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4661.380817] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4661.460639] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4667.345892] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4682.214645] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4682.220081] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4682.226038] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4682.234087] LustreError: Skipped 1 previous similar message [ 4682.294210] Lustre: Skipped 1 previous similar message [ 4684.983851] Lustre: server umount lustre-OST0000 complete [ 4691.937212] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4691.949686] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4691.956479] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4691.959497] Lustre: Skipped 1 previous similar message [ 4695.293333] Lustre: server umount lustre-MDT0000 complete [ 4699.472448] LustreError: 157822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775870851 with bad export cookie 281696783582077094 [ 4699.478195] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4699.488503] LustreError: 157822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4699.903159] Lustre: server umount lustre-MDT0001 complete [ 4710.239106] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 4713.277657] Key type lgssc unregistered [ 4713.608259] LNet: 161348:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4713.618566] LNetError: 161348:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4713.640942] LNet: Removed LNI 192.168.202.147@tcp [ 4714.381757] Key type .llcrypt unregistered [ 4714.382891] Key type ._llcrypt unregistered [ 4741.340794] Key type ._llcrypt registered [ 4741.343640] Key type .llcrypt registered [ 4741.465264] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 4742.847734] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4743.036061] alg: No test for adler32 (adler32-zlib) [ 4744.222318] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 4744.492334] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 4746.175222] Key type lgssc registered [ 4747.564565] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4755.728525] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4755.753506] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4757.418435] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4762.510134] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4767.713067] LustreError: 162748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4767.730944] LustreError: 162748:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4772.854989] LustreError: 162749:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4773.978436] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4774.898693] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4782.181827] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4787.945904] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4791.781607] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4798.304134] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4798.794870] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4802.891324] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4804.444856] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 4812.637270] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4820.689514] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4820.736147] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4820.749917] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4820.763869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.781911] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4821.935626] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4821.968608] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4821.978614] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4821.985552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.994467] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4823.032389] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4823.051860] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4823.059896] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4823.064567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.073266] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4824.056235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.189797] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4825.202488] Lustre: Skipped 1 previous similar message [ 4825.235750] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4825.243473] Lustre: Skipped 1 previous similar message [ 4825.253201] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4825.261170] Lustre: Skipped 1 previous similar message [ 4825.266310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.274658] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4825.279978] Lustre: Skipped 1 previous similar message [ 4826.550892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.943481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.098903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.123338] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4830.127465] Lustre: Skipped 3 previous similar messages [ 4830.154364] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4830.176035] Lustre: Skipped 3 previous similar messages [ 4830.180700] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4830.183171] Lustre: Skipped 3 previous similar messages [ 4830.193512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.203493] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4830.206751] Lustre: Skipped 3 previous similar messages [ 4830.925499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.115493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.839348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.876297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.865208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.809493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.732397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.814274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.510682] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4838.522283] Lustre: Skipped 8 previous similar messages [ 4838.531989] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4838.548878] Lustre: Skipped 8 previous similar messages [ 4838.552271] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4838.554709] Lustre: Skipped 8 previous similar messages [ 4838.572705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.613868] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4838.621501] Lustre: Skipped 8 previous similar messages [ 4839.530314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.323678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.277771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.164191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.124310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.197043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.530646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.621952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.468091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.577640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.540632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.513949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.416421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.278563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.149154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.915726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.830143] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4854.837264] Lustre: Skipped 16 previous similar messages [ 4854.848799] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4854.855531] Lustre: Skipped 16 previous similar messages [ 4854.858683] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4854.861625] Lustre: Skipped 16 previous similar messages [ 4854.867551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.874979] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4854.880637] Lustre: Skipped 16 previous similar messages [ 4855.574161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.556551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.458777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.440068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.235450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.293419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.295497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.068897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.095721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.102098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.121925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.110528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.010554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.058879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.986089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.214248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.252552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.102846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.863538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.678674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.616823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.565279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.477795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.288202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.132027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.335704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.220496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.202654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.015810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.825783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.771112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.732312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.588900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.612785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.611659] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4887.618096] Lustre: Skipped 34 previous similar messages [ 4887.629727] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4887.638085] Lustre: Skipped 34 previous similar messages [ 4887.641960] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4887.647361] Lustre: Skipped 34 previous similar messages [ 4887.651373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.668097] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4887.678679] Lustre: Skipped 34 previous similar messages [ 4888.746789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.844937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.944784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.267933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.634778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.628337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.604597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.360622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.283127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.355762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.233074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.159658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4901.049329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.223348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.337840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.275277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.039561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.882230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.697051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.569488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.456109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.197526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.075260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.898973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.932263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.843920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.720523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.545938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.474862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.423831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.225865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.140081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.918819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.638685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.441448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.324384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.002989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.794668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.665516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.463734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.278683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.005612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.243521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.087478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.914233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.535223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.310868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.069724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.054980] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -108 [ 4932.069554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.071907] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -108 [ 4932.919081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.295360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.367736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.427800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.320050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4938.588205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.098945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.041333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.998670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.173240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.556777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.740085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.315256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.180493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.197457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.068906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.137822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.197768] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4952.205303] Lustre: Skipped 66 previous similar messages [ 4952.221228] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4952.232614] Lustre: Skipped 66 previous similar messages [ 4952.239685] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4952.242422] Lustre: Skipped 66 previous similar messages [ 4952.246979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.256848] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4952.259495] Lustre: Skipped 66 previous similar messages [ 4953.270798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.246730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.451567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.409410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.540884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.383935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.402655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.241451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.303442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.158785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.171167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.287316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.245731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.511390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.784963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.931760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.256532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.004594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.011972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4973.019306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.017610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.274491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.747055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.020867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.168859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.370626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.606413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.711286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.888333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.630824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.399937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.212790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.437071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.539304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.699962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.319076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.606924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.002399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.346154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.402806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.323076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.237329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.268378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.321517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.165378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.032429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.649643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.531326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.456599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.484929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.348918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.452589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.371800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.394256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.285313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.238822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.179754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.222731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.221583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.116562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.088626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.179266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.184180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.420765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.634058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.596412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.649305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.837562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.853353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.911912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.092668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.328273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.084392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.971202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.927869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.108901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.076760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.974647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.919994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.947330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.881024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.857127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.917041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.859204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.806939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.691899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.687779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5047.510764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.641857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.379755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.495733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.517619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.565392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.623819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.836250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.945063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.358807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.511258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.487597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.716388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.424740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.574494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.657921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.780585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.166238] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5066.182520] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5066.216662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.499992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.692285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.997871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.178542] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5071.195659] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5071.199866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.266436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.223504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.204520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.502334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.721197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.764130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.872366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.097181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.126254] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5081.134965] Lustre: Skipped 117 previous similar messages [ 5081.174119] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5081.185580] Lustre: Skipped 117 previous similar messages [ 5081.197135] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5081.205328] Lustre: Skipped 117 previous similar messages [ 5081.213578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.239597] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5081.245621] Lustre: Skipped 117 previous similar messages [ 5082.426014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.424570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.820975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.947759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.321661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.335904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.240069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.463431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.691553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.866197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.088431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.480559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.772241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.219707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.408973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.591026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.603422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.707256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.883513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.638418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.556786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.515558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.726921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.070252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.115776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.344940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.554303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.557892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.664736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.477224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.541270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.426944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.682259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.738121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.767657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.569263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.197742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.117518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.060799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.013916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.197465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.943405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.844940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.803366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5129.750648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5130.551340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.570558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.368967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5133.292810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.239307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.567615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.507927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.616930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.544304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.669471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.683510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.440975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.221162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.185387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.360634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.593740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.879239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.462095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.789881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.030807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.311107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.198271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.408608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.542653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.670167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.732663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.685274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.934437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.602032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.971521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.057682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.090271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.333819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.335622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.495118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.656677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.933872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.644347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.791865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.165861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.478474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.387941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.489571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.400956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.644307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.703099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.625636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.567230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.592253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.353681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.639567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.847321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.798787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.042596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.937173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.024330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.000085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.142404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.081936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.166066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.121587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.033161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.096809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.195575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.191775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.121773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.994928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.739715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5202.511680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.491634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5204.346442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.339663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.157401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.101836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.857809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.717698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.543393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.508882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.403253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.732593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.829486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.251656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.431067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.541680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.414747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.231528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.122160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.963810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.807845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.097843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.035362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.394397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.245691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.360298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.485107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.655461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.995840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.267665] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5232.286751] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5232.293704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.802791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.021199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.091923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.795962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.794254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.792604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.122755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.133645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.486491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.387788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.475437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.689442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.609889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.658873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.866085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.003949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.023868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.846647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.878537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.730045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5254.866105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.757935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.924461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.015213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.877634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.852745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.781526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.877860] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5261.884965] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5261.900201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.950800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5263.863454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.958163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.377382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.809400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5268.964109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.083462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.112613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.306842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.303633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.473133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.512819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.597218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.618969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.651411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.609528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.549238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.444565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.290594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.135114] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5283.146628] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 1 previous similar message [ 5283.154294] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5283.161958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.165297] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) Skipped 1 previous similar message [ 5283.943263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.966835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.884359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.197251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.399543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.341606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5290.329610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5291.268887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.114097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.146101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.158967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.111190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.914413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.825753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.689683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.747575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.739927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5300.559126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5301.645861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.652389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.607453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.580988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.372073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5306.278769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5307.197525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.213222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.055196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.910803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5310.931846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.142464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.081713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.098674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.979131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.994189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.825364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5317.782949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5318.585270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.621383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5320.488585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.389341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.143139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.078866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.839071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.646671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.507656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.578963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.654076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.705506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5329.630074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.624272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.616929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.466467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.565638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.557653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.474061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.256368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.309908] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5337.323907] Lustre: Skipped 247 previous similar messages [ 5337.352524] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5337.359735] Lustre: Skipped 247 previous similar messages [ 5337.363689] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5337.366516] Lustre: Skipped 247 previous similar messages [ 5337.369610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.384484] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5337.396061] Lustre: Skipped 247 previous similar messages [ 5338.208560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.214785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.081903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.147333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.974554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.890336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.759285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.059443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.222734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.203508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5348.205201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.173598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.190537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.094450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5352.069281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5352.824585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.897265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.943943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.793114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.036873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5358.017412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.133373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.893731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5361.131829] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5361.141843] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5361.156454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.251481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5363.355985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.415379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5365.242817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.312703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.963388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.152077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.154924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.209547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.074639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.035310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.071484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.932336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.015544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.837421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.928680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.982073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5378.865628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.740148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5380.553964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.434746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.309055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5383.287335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.216871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.169596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.895479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5386.854307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.886905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5388.754724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.620977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.632940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.517717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5392.798291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5394.043569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.175285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.063606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.858089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5397.511834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.402437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.206387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.112219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.221994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.985404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5402.890432] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5402.900316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5402.913502] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5403.894080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5404.914213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.817071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.864502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.893060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.875794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.987306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.080428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.033962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5413.450302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.636482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.919804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.956294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.986336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.008533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.311677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5421.452530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.379357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.289346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.608779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5425.684621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.496715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.395468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.482802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.299203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.236587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.536307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.572422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.652820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.856893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.838596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.912473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.951188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.117381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.188521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.161489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.998834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.743587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.730209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.886531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5445.748783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.680714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.637139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5448.576344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.379057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5450.393733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.250779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.357720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.146146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5454.262866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.449359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.470207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5457.584703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.848474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.217884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.407970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.590195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.698863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.000243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.310927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.516424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.651045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.461835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.041559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.632442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.068548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.570092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5477.085501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.423304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5479.571445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.495873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.965595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.774106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.816639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.867763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.883969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.940667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.863500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.819822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.159937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.621897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.872525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.070451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.278464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.463336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.537895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.693944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.041584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.412354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.738621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.973789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.414766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.757503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.950358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.074415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.083380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.132333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.393557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.508312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.839753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.920629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.996537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.097551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.901761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.931730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.965563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.995994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.284272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.480908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.776327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.073560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.320101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.669712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.031305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.496029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.981672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.243084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.617611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.991909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.038823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.692216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.893485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.032679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.118699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.286681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.200740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.216664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.285646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.206437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.205079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.168976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.034772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.021967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.071523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.105267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.264887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.408553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.705662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.994621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.241521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.124527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.060361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.828319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.481589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.162406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.088354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.120937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.538568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.751911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.857569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.670474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.775581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.788170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.986848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.933266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.080821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.018499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.070585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.849760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.921196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.811594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.819557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.656773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.658768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.458587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.438295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.436224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.336979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.324825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.200161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.201037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.158443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.923755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.778274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.807255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.706534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.577154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.375409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.151285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.899895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.843959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.674704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.789390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.728564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.659471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.614759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.581587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.457445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.452892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.273976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.181593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.840260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.858292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.592178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.645516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.229424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.039865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.924873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.868345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.735983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.586329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.577313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.595647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.493417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.392701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.205048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.153284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.145511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.022669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.838926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.703354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.471809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.347502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.237307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.356763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.312579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.233556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.234806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.220575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.180807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.085386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.997058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.085095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.370290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.205569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.310593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.454980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.613460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.726735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.051679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.885663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.854210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.764766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.957641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.001181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.234563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.207378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.117644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.043079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.975395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.955955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.079444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.935817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.941574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.775437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.906685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.989038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.821547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.824889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.797416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5667.083511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.164938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.215125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.299225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.271653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.550221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.279914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.236330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.405298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.503927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.520939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.813704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.175047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.432580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5682.816438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.407610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.180909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.242366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.317207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.410696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.517953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.779815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.832611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.773278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.820958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.953745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.937722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.942052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.749636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.020647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.156053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.167665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.195084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.267873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.447727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.399962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.283055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.074887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.287445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.236560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.442253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.346900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.239751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.143204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.505657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.457262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.715984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.808687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.921429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.198705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.542052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.892726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.220182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.423684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5726.574527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.723813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.263449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.417798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.658155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.873645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.867198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.804249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.658483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.637224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.606437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.619141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.417474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.296225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.298640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.609580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.383985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.403754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.537210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.617377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.477820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.488807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.621918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.759058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.921581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.822215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5753.779462] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5753.789297] LustreError: 162768:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5753.798476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.811343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.113369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.083084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5758.126384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.220574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.444647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.588630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5762.850990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5763.865566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.989680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5766.019516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.045953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.025396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.305229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.544052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.885333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5773.263347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.447599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.863442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.991469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.170330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.493178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.658334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5781.887703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.751596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.015674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5785.123745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.279393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.546721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5789.067187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.599135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.651672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.645992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.770151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.903399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5795.946517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.790176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.712519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.688600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.559745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.538803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.415941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.256759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5803.123807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.007621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.904886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.763122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.649195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.531205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5808.352653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.354681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.098380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.991961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.010584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.091834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5814.385152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.562760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.357772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.368441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.310072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.383670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.166261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.978211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.827298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.657410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.417186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.385460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.162152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.079778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.827051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.728912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.492587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5829.371956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.131966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.224734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5832.227129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.120282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.861423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.983849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.983068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.797488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.648023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5838.741833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.806453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.000465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.998566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.985035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.004573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.162751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.104208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.985478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.890082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.887468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.929038] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5849.941750] Lustre: Skipped 492 previous similar messages [ 5849.967455] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5849.991499] Lustre: Skipped 492 previous similar messages [ 5849.999234] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5850.002219] Lustre: Skipped 492 previous similar messages [ 5850.009539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.016768] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5850.019302] Lustre: Skipped 492 previous similar messages [ 5850.931939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5851.851885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.767832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.491681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.174709] LustreError: 164344:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6210.196944] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6210.207963] LustreError: 162768:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 4 previous similar messages [ 6607.330923] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6607.341697] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6607.354020] Lustre: Skipped 4 previous similar messages [ 6607.359946] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6608.374449] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6608.395861] Lustre: Skipped 1 previous similar message [ 6609.559285] Lustre: server umount lustre-OST0000 complete [ 6618.084206] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6618.091196] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6621.374780] Lustre: server umount lustre-MDT0000 complete [ 6623.714473] LustreError: 162748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6623.727340] LustreError: 162748:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6625.777208] LustreError: 163467:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775872777 with bad export cookie 15054484330241843440 [ 6625.781668] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6625.786291] LustreError: 163467:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6626.130882] Lustre: server umount lustre-MDT0001 complete [ 6638.174307] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 6641.954842] Key type lgssc unregistered [ 6642.357778] LNet: 217632:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6642.366655] LNetError: 217632:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6642.406855] LNet: Removed LNI 192.168.202.147@tcp [ 6643.407594] Key type .llcrypt unregistered [ 6643.414897] Key type ._llcrypt unregistered [ 6673.740770] Key type ._llcrypt registered [ 6673.745771] Key type .llcrypt registered [ 6673.870460] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 6675.215667] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6675.290091] alg: No test for adler32 (adler32-zlib) [ 6676.403662] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 6676.653083] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 6678.375600] Key type lgssc registered [ 6679.915809] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6690.502725] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6690.519878] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6692.426966] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6697.962611] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6701.555812] LustreError: 219033:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6701.583043] LustreError: 219033:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6706.656438] LustreError: 219032:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6707.180956] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6707.574143] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6712.793749] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6719.522674] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6723.577884] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6730.281349] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6730.758867] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6736.988373] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 6737.948868] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6744.314813] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6750.209939] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6752.125239] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6752.136957] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6752.141908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6752.150261] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6752.155136] LustreError: 219052:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6757.345556] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6757.370715] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6757.386077] Lustre: Skipped 1 previous similar message [ 6762.484952] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6762.495641] Lustre: Skipped 4 previous similar messages [ 6767.586884] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6767.595539] Lustre: Skipped 1 previous similar message [ 6768.095192] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6768.428661] Lustre: server umount lustre-OST0000 complete [ 6772.191291] LustreError: 219052:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6803.808309] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6804.209141] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6812.403653] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6819.732710] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6822.643821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6822.675872] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6822.683536] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6822.702182] Lustre: Skipped 1 previous similar message [ 6824.899935] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 3 sec [ 6829.324808] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a4a2041b800.ost_server_uuid 50 [ 6831.648087] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a4a2041b800.ost_server_uuid in FULL state after 0 sec [ 6837.548345] Lustre: server umount lustre-OST0000 complete [ 6845.929511] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6845.936135] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6845.954197] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6845.959515] Lustre: Skipped 1 previous similar message [ 6852.584063] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6852.592546] Lustre: Skipped 3 previous similar messages [ 6853.599516] LustreError: 219052:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@00000000fbb7ed5c x1862137626581120/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 0 ref 2 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 6853.757027] Lustre: server umount lustre-MDT0000 complete [ 6853.791317] Lustre: 218344:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775872989/real 1775872989] req@00000000cdc2f434 x1862137626577152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 1 dl 1775873005 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 6853.840408] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6853.847733] Lustre: Skipped 1 previous similar message [ 6853.865461] LustreError: 219032:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6853.905047] LustreError: 219032:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6858.357740] LustreError: 219012:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775873010 with bad export cookie 6618709026390688320 [ 6858.361224] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6858.375488] LustreError: 219012:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6858.948310] Lustre: server umount lustre-MDT0001 complete [ 6870.178939] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 6873.448907] Key type lgssc unregistered [ 6873.857454] LNet: 223696:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6873.873192] LNetError: 223696:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6873.900415] LNet: Removed LNI 192.168.202.147@tcp [ 6875.101428] Key type .llcrypt unregistered [ 6875.102992] Key type ._llcrypt unregistered [ 6909.116706] Key type ._llcrypt registered [ 6909.120915] Key type .llcrypt registered [ 6909.231649] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 6910.410096] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6910.726803] alg: No test for adler32 (adler32-zlib) [ 6911.920444] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 6912.168891] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 6913.839289] Key type lgssc registered [ 6915.199814] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6925.910371] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6925.949670] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6927.609884] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6933.699615] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6938.112266] LustreError: 225411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6938.174048] LustreError: 225411:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6943.201515] LustreError: 225412:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6945.320939] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6945.772275] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6950.310936] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6953.588407] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6961.042864] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6961.443196] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6969.209130] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6972.748608] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 6978.696661] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6978.965664] Lustre: lustre-OST0001: new disk, initializing [ 6978.972684] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6979.161539] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6987.400039] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 6988.598918] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6988.615815] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6988.871980] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7000.262713] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7009.537669] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7032.800122] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7032.808528] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7032.838425] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7034.850385] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7034.854485] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7034.864798] Lustre: Skipped 2 previous similar messages [ 7034.895317] Lustre: Skipped 3 previous similar messages [ 7038.025775] Lustre: server umount lustre-MDT0000 complete [ 7039.975566] LustreError: 225411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7039.989366] LustreError: 225411:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7041.755376] LustreError: 225391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775873193 with bad export cookie 14237943771184986596 [ 7041.757522] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7041.772961] LustreError: 225391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7042.187902] Lustre: server umount lustre-MDT0001 complete [ 7057.620633] Lustre: server umount lustre-OST0000 complete [ 7061.344114] Lustre: 224675:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775873196/real 1775873196] req@ffff93d6dcb32300 x1862137873007872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775873212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7061.366721] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7061.790587] Lustre: server umount lustre-OST0001 complete [ 7087.846362] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 7100.720137] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7101.566164] LustreError: 230745:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7101.758655] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7107.042276] LustreError: 230746:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7107.801923] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7117.287344] LustreError: 230746:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7117.322584] LustreError: 230746:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7120.177714] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7120.960729] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7125.852563] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7128.981686] Lustre: 231854:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7136.305809] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7143.392697] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7145.969362] LustreError: 232206:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7147.009431] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49761) [ 7154.106925] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7154.400320] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7154.404743] Lustre: Skipped 1 previous similar message [ 7155.897709] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7161.255328] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7169.813833] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7174.025057] Lustre: 233700:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7192.549490] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7192.556686] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7192.572126] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7195.618210] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7195.636288] Lustre: Skipped 2 previous similar messages [ 7197.337845] Lustre: server umount mylustre-MDT0000 complete [ 7200.745969] LustreError: 230746:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7200.762754] LustreError: 230746:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 7201.507966] LustreError: 230721:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775873353 with bad export cookie 14237943771184989403 [ 7201.519681] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7201.528879] LustreError: 230721:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7202.294542] Lustre: server umount mylustre-MDT0001 complete [ 7218.351612] Lustre: server umount mylustre-OST0000 complete [ 7232.369949] Lustre: server umount mylustre-OST0001 complete [ 7258.340762] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 7270.297865] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7271.253473] LustreError: 235997:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7271.406368] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7276.277853] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7286.865169] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7292.893528] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7297.311986] Lustre: 237108:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7305.421882] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7313.721797] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7316.224299] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49793) [ 7323.743359] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7326.145217] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 7331.307881] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7340.376702] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7344.047466] Lustre: 238952:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7358.948091] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7358.957759] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7358.966024] Lustre: Skipped 3 previous similar messages [ 7358.979212] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7360.505540] Lustre: server umount tfs-MDT0000 complete [ 7365.142616] LustreError: 235973:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775873516 with bad export cookie 14237943771184991293 [ 7365.147681] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7365.155504] LustreError: 235973:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7365.604785] Lustre: server umount tfs-MDT0001 complete [ 7380.822778] Lustre: server umount tfs-OST0000 complete [ 7385.568032] Lustre: 224674:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775873521/real 1775873521] req@ffff93d6e1942680 x1862137873132672/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775873537 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7385.609273] Lustre: 224674:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 7385.617946] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7385.644208] Lustre: Skipped 3 previous similar messages [ 7386.306046] Lustre: server umount tfs-OST0001 complete [ 7410.154582] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 7422.857794] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7423.544241] LustreError: 241184:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7423.569875] LustreError: 241184:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 12 previous similar messages [ 7423.719739] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7423.725957] Lustre: Skipped 3 previous similar messages [ 7429.306459] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7438.287660] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7444.747557] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7447.934596] Lustre: 242293:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7455.173852] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7462.455946] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7468.942454] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49825) [ 7472.067873] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7473.480906] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 7478.845928] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7486.611651] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7490.163957] Lustre: 244137:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7503.333629] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 22:14:12 (1775873652) [ 7520.741203] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7520.749142] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7520.771774] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7520.774496] Lustre: Skipped 4 previous similar messages [ 7526.490946] Lustre: server umount lustre-MDT0000 complete [ 7530.459581] LustreError: 241159:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775873682 with bad export cookie 14237943771184992959 [ 7530.460408] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7530.478663] LustreError: 241159:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7537.106591] Lustre: server umount lustre-MDT0001 complete [ 7547.954205] Lustre: server umount lustre-OST0000 complete [ 7558.642550] Lustre: server umount lustre-OST0001 complete [ 7565.742697] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 7576.939248] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 7618.886952] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7618.886952] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7618.886952] [ 7618.912361] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7619.189041] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7619.232196] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7619.313301] Lustre: lustre-MDT0000: new disk, initializing [ 7619.418135] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7619.421992] Lustre: Skipped 3 previous similar messages [ 7619.447240] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7623.700776] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7633.688774] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 7633.688774] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7633.688774] [ 7633.734345] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7633.861426] Lustre: 247297:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7633.906453] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7633.909734] Lustre: Skipped 1 previous similar message [ 7633.990716] Lustre: lustre-MDT0001: new disk, initializing [ 7634.194382] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7634.213097] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7638.901583] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7649.145913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7649.294187] Lustre: lustre-OST0000: new disk, initializing [ 7649.297540] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7650.543727] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7650.551070] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7650.665538] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7654.823853] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7664.060522] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7664.281581] Lustre: lustre-OST0001: new disk, initializing [ 7664.294457] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7665.897123] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7665.912521] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7666.036202] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7670.214291] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7681.705420] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 22:17:11 (1775873831) [ 7697.973378] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 22:17:27 (1775873847) [ 7717.346439] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7717.349749] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7717.363214] LustreError: Skipped 1 previous similar message [ 7717.364323] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7717.377058] Lustre: Skipped 6 previous similar messages [ 7717.399389] Lustre: Skipped 9 previous similar messages [ 7718.622678] Lustre: server umount lustre-OST0000 complete [ 7722.466536] LustreError: 248829:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7722.493339] LustreError: 248829:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 13 previous similar messages [ 7728.476922] Lustre: server umount lustre-MDT0000 complete [ 7733.238939] LustreError: 247290:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775873884 with bad export cookie 14237943771184994513 [ 7733.247872] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7733.255855] LustreError: 247290:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7739.655292] Lustre: server umount lustre-MDT0001 complete [ 7750.591112] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 7761.991804] Lustre: server umount lustre-OST0001 complete [ 7768.235995] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 7782.337478] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 7812.688508] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7812.916737] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7812.950848] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7813.036718] Lustre: lustre-MDT0000: new disk, initializing [ 7813.163808] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7816.337984] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7825.479927] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7825.617678] Lustre: 254186:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7825.680953] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7825.685058] Lustre: Skipped 1 previous similar message [ 7825.763186] Lustre: lustre-MDT0001: new disk, initializing [ 7825.871414] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7825.884498] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7831.056958] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7838.979899] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7842.364400] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7848.378788] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7848.824380] Lustre: lustre-OST0000: new disk, initializing [ 7848.828643] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7850.680076] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7850.696066] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7850.818319] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7854.300249] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7860.486542] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7866.337576] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7866.338900] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7866.348838] LustreError: Skipped 1 previous similar message [ 7866.356814] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7866.368406] Lustre: Skipped 5 previous similar messages [ 7866.384711] Lustre: Skipped 9 previous similar messages [ 7871.826627] Lustre: server umount lustre-OST0000 complete [ 7889.375622] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7889.582792] Lustre: server umount lustre-MDT0000 complete [ 7892.831479] LustreError: 254179:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775874044 with bad export cookie 14237943771184995983 [ 7892.833697] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7892.844605] LustreError: 254179:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7893.404354] Lustre: server umount lustre-MDT0001 complete [ 7902.941298] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 7905.859596] Key type lgssc unregistered [ 7906.124323] LNet: 257560:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7906.131487] LNetError: 257560:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7906.152525] LNet: Removed LNI 192.168.202.147@tcp [ 7906.849171] Key type .llcrypt unregistered [ 7906.850779] Key type ._llcrypt unregistered [ 7927.690257] Key type ._llcrypt registered [ 7927.692590] Key type .llcrypt registered [ 7927.779829] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 7928.693043] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7928.821541] alg: No test for adler32 (adler32-zlib) [ 7929.795259] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 7929.995882] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 7931.623182] Key type lgssc registered [ 7932.586565] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7939.146641] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7939.175379] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7940.622751] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7944.153352] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7950.749370] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7950.816707] LustreError: 258984:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7950.841634] LustreError: 258984:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7951.031270] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7955.183403] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7959.420447] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7962.732149] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7968.022261] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7968.364988] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7973.221449] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 7978.385068] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7979.362641] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7981.026775] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7981.038764] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7981.060136] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7983.222387] Lustre: server umount lustre-OST0000 complete [ 7987.172226] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7987.179615] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7987.204477] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7991.264142] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7991.265480] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7992.544272] Lustre: server umount lustre-MDT0000 complete [ 7996.173660] LustreError: 258966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775874147 with bad export cookie 10025268364868080741 [ 7996.182357] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7996.410828] Lustre: server umount lustre-MDT0001 complete [ 8004.577451] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 8006.775860] Key type lgssc unregistered [ 8006.990939] LNet: 262212:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8006.996277] LNetError: 262212:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8007.015770] LNet: Removed LNI 192.168.202.147@tcp [ 8007.666290] Key type .llcrypt unregistered [ 8007.668422] Key type ._llcrypt unregistered [ 8020.322181] Key type ._llcrypt registered [ 8020.323470] Key type .llcrypt registered [ 8020.404597] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 8021.275876] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8021.414108] alg: No test for adler32 (adler32-zlib) [ 8022.402704] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 8022.595457] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 8024.231867] Key type lgssc registered [ 8025.039905] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8031.969427] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8031.983238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8047.519656] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 8052.647630] LustreError: 263366:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.147@tcp: failed processing log, type 4: rc = -110 [ 8079.327196] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8083.602083] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8087.856637] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8089.481495] Lustre: server umount lustre-OST0000 complete [ 8102.960277] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 8104.985883] Key type lgssc unregistered [ 8105.224586] LNet: 264865:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8105.232350] LNetError: 264865:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8105.243256] LNet: Removed LNI 192.168.202.147@tcp [ 8105.840743] Key type .llcrypt unregistered [ 8105.844111] Key type ._llcrypt unregistered [ 8137.262272] Key type ._llcrypt registered [ 8137.264095] Key type .llcrypt registered [ 8137.336349] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 8138.044673] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8138.109096] alg: No test for adler32 (adler32-zlib) [ 8139.093651] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 8139.245942] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 8140.887154] Key type lgssc registered [ 8141.807214] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8152.420667] loop0: detected capacity change from 0 to 204800000 [ 8152.563076] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8152.572755] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8152.797029] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8153.640984] loop0: detected capacity change from 0 to 204800000 [ 8153.808648] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8153.823497] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8154.058585] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8154.890729] loop0: detected capacity change from 0 to 204800000 [ 8155.056864] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8155.075274] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8155.201738] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8156.011551] loop0: detected capacity change from 0 to 204800000 [ 8156.168820] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8157.012757] loop0: detected capacity change from 0 to 204800000 [ 8157.042125] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8160.284844] loop0: detected capacity change from 0 to 204800000 [ 8160.312037] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8163.071294] loop0: detected capacity change from 0 to 204800000 [ 8163.093471] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8166.292464] loop0: detected capacity change from 0 to 204800000 [ 8166.313220] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8169.420440] loop0: detected capacity change from 0 to 204800000 [ 8169.510766] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8169.556821] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8169.635177] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8169.648070] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 8169.674695] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 8169.696353] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 8169.711354] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 8169.727606] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8169.747480] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8169.761247] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8169.773611] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 8169.794723] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 8169.816287] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 8169.827379] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 8169.843106] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 8169.859994] Lustre: 268260:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8174.298798] Lustre: server umount MGS complete [ 8175.032793] loop0: detected capacity change from 0 to 204800000 [ 8175.086877] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8175.499639] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8175.546646] Lustre: lustre-MDT0000: Aborting client recovery [ 8176.319113] loop1: detected capacity change from 0 to 204800000 [ 8176.459807] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8176.501394] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8176.509425] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8176.522603] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8176.533261] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8176.543309] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8176.552580] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8176.561377] Lustre: 268692:0:(osd_scrub.c:1829:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8176.580293] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8176.739071] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8176.780048] Lustre: lustre-MDT0001: Aborting client recovery [ 8177.484746] loop2: detected capacity change from 0 to 204800000 [ 8177.628253] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8177.686673] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8177.693824] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8177.703043] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8177.721829] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8177.736081] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8177.745287] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8177.755927] Lustre: 268772:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8177.897831] Lustre: Found index 0 for lustre-OST0000, updating log [ 8178.030175] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8178.053190] Lustre: lustre-OST0000: Aborting recovery [ 8178.737060] loop3: detected capacity change from 0 to 204800000 [ 8178.877907] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8178.940817] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8178.953317] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8178.965523] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8178.976305] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8178.984204] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8178.992534] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8179.002335] Lustre: 268855:0:(osd_scrub.c:1829:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8179.017267] Lustre: Found index 1 for lustre-OST0001, updating log [ 8179.115825] Lustre: lustre-OST0001: Aborting recovery [ 8184.360072] LustreError: 268636:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 9, retries 0, failed: rc = -108 [ 8186.343163] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8186.343503] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8186.346748] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8186.352598] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8186.392581] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8186.420579] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8192.512585] LustreError: 268603:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 514us: rc = -2 [ 8193.012711] LustreError: 268600:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0001: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0001 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0001/identity_upcall, time 3825us: rc = -2 [ 8193.034845] LustreError: 268600:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 27 previous similar messages [ 8206.823532] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8206.827736] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8206.834506] Lustre: Skipped 2 previous similar messages [ 8206.840578] Lustre: Skipped 1 previous similar message [ 8211.170909] Lustre: server umount lustre-MDT0000 complete [ 8211.833568] LustreError: 268587:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775874363 with bad export cookie 1830753101563606780 [ 8211.846810] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8211.850923] LustreError: 268587:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8211.935762] LustreError: 268602:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8211.939890] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8211.940376] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8211.940380] Lustre: Skipped 2 previous similar messages [ 8211.950743] LustreError: 268602:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8211.959597] Lustre: Skipped 2 previous similar messages [ 8217.066291] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8217.066291] LustreError: 268601:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8217.085215] Lustre: Skipped 2 previous similar messages [ 8222.177276] LustreError: 268601:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8222.177615] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8222.190794] LustreError: 268601:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8222.204780] Lustre: Skipped 1 previous similar message [ 8226.271302] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8226.529610] Lustre: server umount lustre-MDT0001 complete [ 8233.417638] Lustre: server umount lustre-OST0000 complete [ 8240.287931] Lustre: server umount lustre-OST0001 complete [ 8245.946687] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 22:26:36 (1775874396) [ 8266.678990] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 8273.992284] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 8301.692523] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8301.918881] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8301.937506] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8301.998840] Lustre: lustre-MDT0000: new disk, initializing [ 8302.052367] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8302.056076] Lustre: Skipped 1 previous similar message [ 8302.063974] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8305.435316] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8313.763287] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8313.853156] Lustre: 272907:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8313.894875] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8313.900539] Lustre: Skipped 1 previous similar message [ 8313.955736] Lustre: lustre-MDT0001: new disk, initializing [ 8314.029220] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8314.061245] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8314.077812] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8317.141505] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8323.129738] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8326.068467] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8331.212133] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8331.423483] Lustre: lustre-OST0000: new disk, initializing [ 8331.430844] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8331.518145] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8336.316817] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8337.473079] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8337.479772] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8337.547303] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8342.391475] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8346.226774] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8356.734667] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8368.676825] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8379.974741] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8414.688980] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8414.699655] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8414.705688] LustreError: Skipped 1 previous similar message [ 8414.706637] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8414.735582] Lustre: Skipped 1 previous similar message [ 8420.635027] Lustre: server umount lustre-OST0000 complete [ 8424.932284] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8424.936280] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8424.941989] Lustre: Skipped 1 previous similar message [ 8424.946216] Lustre: Skipped 3 previous similar messages [ 8430.025958] Lustre: server umount lustre-MDT0000 complete [ 8430.050825] LustreError: 272917:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8430.064255] LustreError: 272917:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8433.379407] LustreError: 276471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775874585 with bad export cookie 1830753101563609503 [ 8433.384484] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8433.388485] LustreError: 276471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 8433.747605] Lustre: server umount lustre-MDT0001 complete [ 8440.505484] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8444.127763] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8447.733428] Lustre: server umount MGS complete [ 8456.194768] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8456.555512] LustreError: 278541:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8456.568442] LustreError: 278554:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8456.620315] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8460.044289] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8466.914946] LustreError: 278542:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8466.934638] LustreError: 278542:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8467.258360] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8472.106950] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8477.063271] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8480.142830] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8485.989176] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8491.448537] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8496.081215] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8527.329242] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8527.350882] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8527.355850] Lustre: Skipped 1 previous similar message [ 8528.867631] Lustre: server umount lustre-OST0000 complete [ 8546.271409] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8546.451259] Lustre: server umount lustre-MDT0000 complete [ 8547.810481] LustreError: 278536:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8547.834413] LustreError: 278536:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8549.647068] LustreError: 278523:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775874701 with bad export cookie 1830753101563611344 [ 8549.650610] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8549.656019] LustreError: 278523:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8549.881505] Lustre: server umount lustre-MDT0001 complete [ 8558.973435] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 8561.354679] Key type lgssc unregistered [ 8561.617604] LNet: 282132:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8561.628885] LNetError: 282132:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8562.664363] LNet: Removed LNI 192.168.202.147@tcp [ 8563.284282] Key type .llcrypt unregistered [ 8563.286165] Key type ._llcrypt unregistered [ 8597.237175] Key type ._llcrypt registered [ 8597.240377] Key type .llcrypt registered [ 8597.320903] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 8609.656798] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 8610.794543] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8610.817120] alg: No test for adler32 (adler32-zlib) [ 8611.824462] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 8611.996097] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 8613.623186] Key type lgssc registered [ 8614.710276] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8641.388357] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8641.407611] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8642.661436] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8642.685775] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8642.734487] Lustre: lustre-MDT0000: new disk, initializing [ 8642.795226] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8642.814900] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8646.630782] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8655.418929] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8655.510327] Lustre: 286036:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8655.558312] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8655.562695] Lustre: Skipped 1 previous similar message [ 8655.628813] Lustre: lustre-MDT0001: new disk, initializing [ 8655.723374] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8655.754482] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8655.764970] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8659.008252] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8665.277825] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8668.281657] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8674.392897] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8674.619257] Lustre: lustre-OST0000: new disk, initializing [ 8674.623266] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8674.683869] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8679.705899] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8684.126222] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8684.141244] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8684.237089] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8685.985553] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8692.409305] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8695.813790] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8704.291773] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8708.404890] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8751.074867] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8751.077479] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8751.083489] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8751.089550] Lustre: Skipped 1 previous similar message [ 8756.193654] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8756.198560] Lustre: Skipped 2 previous similar messages [ 8761.311152] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8761.315671] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8761.482516] Lustre: server umount lustre-OST0000 complete [ 8766.440765] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8766.441444] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8766.448917] Lustre: Skipped 1 previous similar message [ 8766.458883] Lustre: Skipped 2 previous similar messages [ 8771.555589] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8771.559975] Lustre: Skipped 1 previous similar message [ 8779.231532] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8779.446145] Lustre: server umount lustre-MDT0000 complete [ 8782.229402] LustreError: 288517:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775874933 with bad export cookie 5218108205285967644 [ 8782.231340] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8782.240608] LustreError: 288517:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8782.514412] Lustre: server umount lustre-MDT0001 complete [ 8788.399153] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8791.258521] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8794.688045] Lustre: server umount MGS complete [ 8802.690526] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8803.044159] LustreError: 291413:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8803.056110] LustreError: 291413:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8803.068855] LustreError: 291426:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8803.107794] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8806.364165] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8808.427962] LustreError: 291414:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8812.525825] LustreError: 291413:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8813.071741] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8813.300084] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8817.528568] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8821.456724] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8824.299742] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8829.226514] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8829.546183] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8834.007332] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8837.963727] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8879.073271] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8879.076190] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8879.086660] Lustre: Skipped 1 previous similar message [ 8879.087412] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8879.096230] Lustre: Skipped 3 previous similar messages [ 8881.535392] Lustre: server umount lustre-OST0000 complete [ 8885.216355] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8885.226107] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8889.314875] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8890.673851] Lustre: server umount lustre-MDT0000 complete [ 8893.153254] LustreError: 293825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775875044 with bad export cookie 5218108205285969485 [ 8893.161118] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8893.171310] LustreError: 293825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8893.375878] Lustre: server umount lustre-MDT0001 complete [ 8901.768210] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 8903.584773] Key type lgssc unregistered [ 8903.824975] LNet: 295027:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8903.833256] LNetError: 295027:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8903.846546] LNet: Removed LNI 192.168.202.147@tcp [ 8904.369699] Key type .llcrypt unregistered [ 8904.374222] Key type ._llcrypt unregistered [ 8918.384506] Key type ._llcrypt registered [ 8918.388527] Key type .llcrypt registered [ 8918.464337] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 8927.134237] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 8927.867076] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8927.888102] alg: No test for adler32 (adler32-zlib) [ 8928.827156] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 8928.979380] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 8930.599509] Key type lgssc registered [ 8931.327322] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8946.686686] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 8956.912129] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8956.925114] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8958.102603] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8958.122668] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8958.192291] Lustre: lustre-MDT0000: new disk, initializing [ 8958.238771] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8958.253322] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8960.932460] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8968.336297] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8968.507413] Lustre: lustre-OST0000: new disk, initializing [ 8968.510274] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8968.512625] Lustre: Skipped 1 previous similar message [ 8968.555193] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8972.739577] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 8973.391972] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8973.412625] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8973.441084] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9442.276360] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9442.285469] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9447.392751] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9448.295225] Lustre: server umount lustre-MDT0000 complete [ 9450.661732] LustreError: 298187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775875602 with bad export cookie 6220122128276949275 [ 9450.662864] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9450.673557] LustreError: 298187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 9450.775129] Lustre: server umount lustre-OST0000 complete [ 9465.723962] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [ 9471.325606] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 9492.659224] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9492.792471] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9492.813756] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9492.857401] Lustre: lustre-MDT0000: new disk, initializing [ 9492.908459] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9492.921764] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9495.629324] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9502.083294] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9502.154926] Lustre: 303203:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9502.216966] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9502.219226] Lustre: Skipped 1 previous similar message [ 9502.258439] Lustre: lustre-MDT0001: new disk, initializing [ 9502.316751] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9502.356866] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9502.368200] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9504.593975] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9509.409054] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9511.474838] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9515.497432] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9515.651978] Lustre: lustre-OST0000: new disk, initializing [ 9515.655797] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9515.722875] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9517.583767] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9517.594554] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9517.690650] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9519.140589] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9523.890990] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9526.670900] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9526.824226] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9529.513875] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9529.605468] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9532.896049] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9532.901574] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9532.902635] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9532.907576] Lustre: Skipped 1 previous similar message [ 9536.836160] Lustre: server umount lustre-OST0000 complete [ 9543.136199] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9543.137044] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9543.139299] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9543.139305] Lustre: Skipped 1 previous similar message [ 9543.151538] Lustre: Skipped 1 previous similar message [ 9548.256587] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9548.260225] Lustre: Skipped 2 previous similar messages [ 9553.375369] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9553.518748] Lustre: server umount lustre-MDT0000 complete [ 9555.700170] LustreError: 303195:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775875707 with bad export cookie 6220122128279890073 [ 9555.700973] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9555.706132] LustreError: 303195:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9555.882534] Lustre: server umount lustre-MDT0001 complete [ 9557.810943] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 9558.737344] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 22:48:29 (1775875709) [ 9562.642410] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9562.904293] LustreError: 307106:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9562.919141] LustreError: 307106:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9562.951400] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9565.182648] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9568.225413] LustreError: 307107:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9570.437740] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9573.425963] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9576.963391] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9579.385165] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9583.426647] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9583.652377] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9583.661207] Lustre: Skipped 1 previous similar message [ 9587.009591] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9590.325898] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9594.469875] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9594.596217] Lustre: lustre-OST0001: new disk, initializing [ 9594.600171] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 9597.239997] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 9597.248141] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 9597.271506] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9598.305687] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9598.313662] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 9598.318656] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9599.333248] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9599.338446] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9601.379686] LustreError: 309855:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9601.386390] LustreError: 309855:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 9603.869816] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9604.012625] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9605.475563] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9605.481174] LustreError: 309847:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 9606.339153] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a4a05018000.ost_server_uuid 50 [ 9607.099060] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a4a05018000.ost_server_uuid in FULL state after 0 sec [ 9609.212557] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8a4a05018000.ost_server_uuid 50 [ 9610.044734] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8a4a05018000.ost_server_uuid in FULL state after 0 sec [ 9611.635446] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 9627.106428] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9627.106823] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9627.113514] LustreError: Skipped 1 previous similar message [ 9627.121665] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9627.121674] Lustre: Skipped 2 previous similar messages [ 9627.128043] Lustre: Skipped 1 previous similar message [ 9629.276583] Lustre: server umount lustre-OST0001 complete [ 9632.677984] Lustre: server umount lustre-OST0000 complete [ 9637.344195] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9637.347839] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9643.492581] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9643.497367] Lustre: Skipped 8 previous similar messages [ 9648.607197] Lustre: 296297:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775875784/real 1775875784] req@00000000947b16ee x1862139988051712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 1 dl 1775875800 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 9648.621448] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9648.631948] Lustre: Skipped 1 previous similar message [ 9649.119124] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9649.195553] Lustre: server umount lustre-MDT0000 complete [ 9651.070499] LustreError: 307088:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775875802 with bad export cookie 6220122128279890955 [ 9651.072223] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9651.080986] LustreError: 307088:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9651.285100] Lustre: server umount lustre-MDT0001 complete [ 9657.659314] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 9659.180583] Key type lgssc unregistered [ 9659.331974] LNet: 312044:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9659.337542] LNetError: 312044:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9659.347516] LNet: Removed LNI 192.168.202.147@tcp [ 9659.846292] Key type .llcrypt unregistered [ 9659.848824] Key type ._llcrypt unregistered [ 9674.304320] Key type ._llcrypt registered [ 9674.306279] Key type .llcrypt registered [ 9674.381360] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 9675.092832] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9675.121469] alg: No test for adler32 (adler32-zlib) [ 9676.079072] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 9676.234747] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 9677.855262] Key type lgssc registered [ 9678.584298] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9683.756583] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9683.771529] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9685.046874] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9687.563606] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9691.356793] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9695.200258] LustreError: 313425:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9695.210534] LustreError: 313425:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9695.579274] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9695.853780] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9698.465659] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9704.125776] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9704.354422] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9705.399141] LustreError: 314973:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9708.302614] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9709.541876] LustreError: 314976:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9709.562650] LustreError: 314976:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9709.568522] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 9711.542207] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9714.661775] LustreError: 315428:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9714.672489] LustreError: 315428:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9716.464162] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9716.646540] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9718.852896] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 9719.673614] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9722.990921] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 9726.667529] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 9726.800567] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9816.032893] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9816.037228] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9816.038059] LustreError: Skipped 1 previous similar message [ 9816.039031] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9816.054399] Lustre: Skipped 1 previous similar message [ 9816.069265] Lustre: Skipped 1 previous similar message [ 9819.105778] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9824.230774] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9824.236858] Lustre: Skipped 2 previous similar messages [ 9829.343286] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9829.353078] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9829.359820] Lustre: Skipped 1 previous similar message [ 9829.413968] Lustre: server umount lustre-OST0001 complete [ 9833.442322] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9833.449344] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9833.470741] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9834.481211] LustreError: 315428:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9834.486507] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9834.495732] LustreError: 315428:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9839.432993] Lustre: server umount lustre-OST0000 complete [ 9844.195651] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9844.201293] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9844.214187] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9844.217632] Lustre: Skipped 2 previous similar messages [ 9847.995571] Lustre: server umount lustre-MDT0000 complete [ 9849.825041] LustreError: 316721:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9849.839173] LustreError: 316721:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9850.587472] LustreError: 313406:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775876002 with bad export cookie 7759232787346103849 [ 9850.596410] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9850.598044] LustreError: 313406:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9850.857976] Lustre: server umount lustre-MDT0001 complete [ 9857.416305] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [ 9859.291736] Key type lgssc unregistered [ 9859.506242] LNet: 317984:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9859.514949] LNetError: 317984:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9859.533576] LNet: Removed LNI 192.168.202.147@tcp [ 9860.072482] Key type .llcrypt unregistered [ 9860.074725] Key type ._llcrypt unregistered [ 9887.903708] Key type ._llcrypt registered [ 9887.905571] Key type .llcrypt registered [ 9887.973454] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [ 9888.526985] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9888.554634] alg: No test for adler32 (adler32-zlib) [ 9889.486414] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [ 9889.618855] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [ 9891.247538] Key type lgssc registered [ 9891.915238] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9897.675555] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9897.684101] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9899.020929] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9901.970638] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9907.642517] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9907.842183] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9910.640939] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9912.523715] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 9916.709365] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9916.896870] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9917.931507] LustreError: 321691:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9917.948605] LustreError: 321691:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9920.348017] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9923.045228] LustreError: 321692:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9924.069297] LustreError: 321692:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9924.076640] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 9924.079773] LustreError: 321692:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9926.071494] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9926.302684] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9930.785363] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [ 9931.780152] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 9937.094778] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 9946.414973] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 9957.345650] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9957.351370] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9957.353143] Lustre: Skipped 2 previous similar messages [ 9962.465730] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9962.468050] Lustre: Skipped 4 previous similar messages [ 9963.132383] Lustre: server umount lustre-MDT0000 complete [ 9964.965723] LustreError: 321712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775876116 with bad export cookie 12089683738780613529 [ 9964.971046] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9964.974946] LustreError: 321712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9965.130428] Lustre: server umount lustre-MDT0001 complete [ 9976.864843] Lustre: server umount lustre-OST0000 complete [ 9989.424436] Lustre: server umount lustre-OST0001 complete [ 9997.609219] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [10003.211872] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10003.415694] LustreError: 325417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10003.466962] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10006.142291] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10008.548495] LustreError: 325418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10011.517567] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10011.732296] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10014.027318] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10015.693895] Lustre: 326523:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10019.918471] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10022.182040] LustreError: 326876:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10023.038435] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10027.291846] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10028.465856] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10028.468045] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10030.688190] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10034.971328] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10036.716890] Lustre: 328368:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10043.872328] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10043.875665] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10043.881032] Lustre: Skipped 6 previous similar messages [10043.884076] Lustre: Skipped 2 previous similar messages [10048.993427] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10049.003323] Lustre: Skipped 3 previous similar messages [10049.256146] Lustre: server umount lustre-MDT0000 complete [10051.172932] LustreError: 325397:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775876202 with bad export cookie 12089683738780615230 [10051.174768] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10051.179640] LustreError: 325397:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10051.332062] Lustre: server umount lustre-MDT0001 complete [10064.400551] Lustre: server umount lustre-OST0000 complete [10076.415170] Lustre: server umount lustre-OST0001 complete [10078.340458] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10079.172066] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10080.242871] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 22:57:10 (1775876230) [10091.437780] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [10095.964057] loop0: detected capacity change from 0 to 1099511627776 [10096.158334] SGI XFS with ACLs, security attributes, quota, no debug enabled [10096.161268] *** VALIDATE xfs *** [10096.166175] XFS (loop0): Mounting V5 Filesystem [10096.185775] XFS (loop0): Ending clean mount [10096.955123] loop1: detected capacity change from 0 to 18691697672192 [10129.840892] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [10135.065320] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [10151.516238] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10151.637140] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10151.654329] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10151.696948] Lustre: lustre-MDT0000: new disk, initializing [10151.745233] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10151.747583] Lustre: Skipped 2 previous similar messages [10151.755044] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10153.617680] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10158.810309] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10158.870272] Lustre: 333432:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10158.899972] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10158.902513] Lustre: Skipped 1 previous similar message [10158.941646] Lustre: lustre-MDT0001: new disk, initializing [10158.998986] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10159.002955] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10160.662056] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10164.195492] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10165.703329] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10168.679859] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10168.821337] Lustre: lustre-OST0000: new disk, initializing [10168.825345] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10170.566641] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10170.571534] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10170.626150] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10171.513808] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10175.493790] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10177.149988] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10177.238868] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10178.991021] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10179.083577] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10181.090756] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10181.090789] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10181.091815] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10181.096437] Lustre: Skipped 1 previous similar message [10181.103971] LustreError: Skipped 1 previous similar message [10191.331207] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10191.333547] Lustre: Skipped 4 previous similar messages [10194.399123] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10194.468562] Lustre: server umount lustre-OST0000 complete [10196.451416] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10196.460180] Lustre: Skipped 1 previous similar message [10210.271120] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10210.344916] Lustre: server umount lustre-MDT0000 complete [10211.793310] LustreError: 333424:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775876363 with bad export cookie 12089683738780616784 [10211.795268] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10211.797237] LustreError: 333424:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10211.930487] Lustre: server umount lustre-MDT0001 complete [10215.228584] XFS (loop0): Unmounting Filesystem [10217.107179] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 22:59:27 (1775876367) [10219.854766] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10220.046113] LustreError: 337584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10220.084945] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10220.088989] Lustre: Skipped 2 previous similar messages [10221.649674] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10225.120697] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10226.698714] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10229.007972] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10230.417379] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10233.090914] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10235.754829] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10237.884106] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10254.816977] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10254.825263] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10254.831501] Lustre: Skipped 1 previous similar message [10254.832833] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10254.839227] Lustre: Skipped 7 previous similar messages [10258.353807] Lustre: server umount lustre-OST0000 complete [10274.271212] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10274.342145] Lustre: server umount lustre-MDT0000 complete [10275.296083] LustreError: 337604:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10275.302688] LustreError: 337604:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10275.710193] LustreError: 337566:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775876427 with bad export cookie 12089683738780617666 [10275.712634] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10275.714734] LustreError: 337566:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10275.864774] Lustre: server umount lustre-MDT0001 complete [10279.643281] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [10280.899643] Key type lgssc unregistered [10281.044492] LNet: 340878:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10281.047647] LNetError: 340878:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10281.057538] LNet: Removed LNI 192.168.202.147@tcp [10281.398130] Key type .llcrypt unregistered [10281.399863] Key type ._llcrypt unregistered [10293.110990] Key type ._llcrypt registered [10293.112474] Key type .llcrypt registered [10293.153153] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [10293.635172] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10293.643113] alg: No test for adler32 (adler32-zlib) [10294.511444] Lustre: Lustre: Build Version: 2.17.52_3_gc81aec7 [10294.612501] LNet: Added LNI 192.168.202.147@tcp [8/256/0/180] [10296.191115] Key type lgssc registered [10296.633579] Lustre: Echo OBD driver; http://www.lustre.org/ [10299.635829] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10299.643141] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10300.809061] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10302.246819] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10305.307360] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10305.469061] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10306.988664] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10308.978248] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10310.314960] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10312.905419] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10313.019972] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10314.947687] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10316.975032] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10330.593769] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10330.594619] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10330.598153] Lustre: Skipped 1 previous similar message [10332.660100] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.47@tcp (stopping) [10332.662064] Lustre: Skipped 1 previous similar message [10335.713158] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10336.206505] Lustre: server umount lustre-MDT0001 complete [10337.773548] LustreError: 344578:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10337.780048] LustreError: 344578:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10339.903931] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10339.935742] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10339.937588] Lustre: Found index 1 for lustre-MDT0001, updating log [10339.949669] Lustre: 342395:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10340.048761] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10341.408835] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10345.444082] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10346.981071] LustreError: 345802:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10346.984207] LustreError: 345802:0:(tgt_mount.c:666:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10346.988064] LustreError: 342397:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10347.006433] LustreError: 345805:0:(obd_config.c:2101:class_config_llog_handler()) MGC192.168.202.147@tcp: cfg command failed: rc = -17 [10347.010437] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [10347.010437] [10644.981785] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.47@tcp (stopping) [10644.984210] Lustre: Skipped 1 previous similar message [10647.521796] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10647.521839] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10647.528107] Lustre: Skipped 1 previous similar message [10650.092513] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.47@tcp (stopping) [10650.095372] Lustre: Skipped 2 previous similar messages [10650.514104] Lustre: server umount lustre-MDT0001 complete [10652.640422] LustreError: 342405:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10652.645538] LustreError: 342405:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10653.829755] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10653.862124] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10653.863865] Lustre: Found index 1 for lustre-MDT0001, updating log [10653.875269] Lustre: 342392:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10653.979371] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10655.298765] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10659.299939] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10661.349090] LustreError: 358352:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10661.351140] LustreError: 358352:0:(tgt_mount.c:666:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10661.353753] LustreError: 342397:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10661.355651] LustreError: 342397:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10661.369597] LustreError: 358355:0:(obd_config.c:760:class_setup()) Device 8 already setup (type osp) [10661.371578] LustreError: 358355:0:(obd_config.c:864:class_detach()) OBD device 8 still set up [10661.373206] LustreError: 358355:0:(obd_config.c:2101:class_config_llog_handler()) MGC192.168.202.147@tcp: cfg command failed: rc = -17 [10661.375495] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.147@tcp [10661.375495] [10961.377444] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10961.377771] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10961.383508] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10961.387411] Lustre: Skipped 1 previous similar message [10963.729418] Lustre: server umount lustre-MDT0001 complete [10966.496364] LustreError: 343677:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10966.501048] LustreError: 343677:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10967.078453] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10967.111710] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10967.113984] Lustre: Found index 1 for lustre-MDT0001, updating log [10967.126366] Lustre: 342392:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10967.228507] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [10968.471879] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [10972.645385] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10975.204618] LustreError: 370961:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10975.207360] LustreError: 370961:0:(tgt_mount.c:666:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10975.210432] LustreError: 342397:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10975.212608] LustreError: 342397:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10975.228386] LustreError: 370964:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [10975.234072] LustreError: 370964:0:(obd_config.c:2101:class_config_llog_handler()) MGC192.168.202.147@tcp: cfg command failed: rc = -114 [10975.236777] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [10975.236777] [11284.962247] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11284.963112] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11284.966499] Lustre: Skipped 3 previous similar messages [11284.966752] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11284.969129] Lustre: Skipped 3 previous similar messages [11289.369875] Lustre: server umount lustre-MDT0000 complete [11290.080885] LustreError: 346922:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11290.086214] LustreError: 346922:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11290.569325] LustreError: 345285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775877442 with bad export cookie 14502870216114824796 [11290.571061] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11290.573811] LustreError: 345285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11295.200314] LustreError: 342402:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11295.200566] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11296.760863] Lustre: server umount lustre-MDT0001 complete [11298.114156] Lustre: server umount lustre-OST0000 complete [11301.257754] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [11304.449171] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [11316.686142] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 23:17:47 (1775877467) [11318.897264] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11318.989773] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11319.002569] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11319.041406] Lustre: lustre-MDT0000: new disk, initializing [11319.068606] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11319.076238] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11320.437556] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [11324.790194] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11324.834117] Lustre: 385488:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11324.862043] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11324.864390] Lustre: Skipped 1 previous similar message [11324.900935] Lustre: lustre-MDT0001: new disk, initializing [11324.935148] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11324.946187] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11324.950087] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11326.223287] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [11329.375321] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11330.601886] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11333.071050] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11333.179576] Lustre: lustre-OST0000: new disk, initializing [11333.182245] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11333.217733] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11335.226933] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11335.230600] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11335.266622] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11335.267538] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug -1 all [11338.430514] Lustre: DEBUG MARKER: oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11345.376333] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11345.380045] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11345.381153] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11345.381158] Lustre: Skipped 1 previous similar message [11345.390784] Lustre: Skipped 2 previous similar messages [11347.223863] Lustre: server umount lustre-MDT0000 complete [11348.484020] LustreError: 385479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775877500 with bad export cookie 14502870216114826742 [11348.485299] LustreError: MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11348.486284] LustreError: 386279:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [11348.487982] LustreError: 385479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11348.611599] Lustre: server umount lustre-MDT0001 complete [11360.282263] Lustre: server umount lustre-OST0000 complete [11369.703805] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing set_hostid [11372.783780] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local [11382.792385] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 11202 sec ========= 23:18:53 (1775877533) [11383.295732] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 23:18:54 (1775877534) === [11384.362285] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 23:18:55 (1775877535) === [11396.683121] Lustre: DEBUG MARKER: oleg247-server.virtnet: executing unload_modules_local [11397.755662] Key type lgssc unregistered [11397.894467] LNet: 393423:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11397.897682] LNetError: 393423:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11397.907453] LNet: Removed LNI 192.168.202.147@tcp [11398.226693] Key type .llcrypt unregistered [11398.227737] Key type ._llcrypt unregistered