[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 555714617 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524592K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.003369] x2apic enabled [ 0.004009] Switched APIC routing to physical x2apic. [ 0.005012] kvm-guest: setup PV IPIs [ 0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008049] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009023] pid_max: default: 32768 minimum: 301 [ 0.010231] LSM: Security Framework initializing [ 0.011050] Yama: becoming mindful. [ 0.012037] SELinux: Initializing. [ 0.013075] *** VALIDATE selinux *** [ 0.021789] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.027272] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028144] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030065] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031109] *** VALIDATE tmpfs *** [ 0.033192] *** VALIDATE proc *** [ 0.034214] *** VALIDATE cgroup *** [ 0.035000] *** VALIDATE cgroup2 *** [ 0.035252] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037127] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.038010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039029] Spectre V2 : User space: Vulnerable [ 0.040008] Speculative Store Bypass: Vulnerable [ 0.043168] debug: unmapping init [mem 0xffffffff9d459000-0xffffffff9d460fff] [ 0.045795] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.046764] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047021] ... version: 2 [ 0.048011] ... bit width: 48 [ 0.049012] ... generic registers: 4 [ 0.050012] ... value mask: 0000ffffffffffff [ 0.051020] ... max period: 00007fffffffffff [ 0.052014] ... fixed-purpose events: 3 [ 0.053010] ... event mask: 000000070000000f [ 0.054302] rcu: Hierarchical SRCU implementation. [ 0.056463] smp: Bringing up secondary CPUs ... [ 0.057582] x86: Booting SMP configuration: [ 0.058028] .... node #0, CPUs: #1 #2 #3 [ 0.061380] smp: Brought up 1 node, 4 CPUs [ 0.063012] smpboot: Max logical packages: 1 [ 0.064019] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.129353] node 0 deferred pages initialised in 64ms [ 0.133466] devtmpfs: initialized [ 0.135281] x86/mm: Memory block size: 128MB [ 0.139198] gcov: version magic: 0x41383552 [ 0.141202] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.145072] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.147426] pinctrl core: initialized pinctrl subsystem [ 0.149224] [ 0.149656] ************************************************************* [ 0.152011] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.153011] ** ** [ 0.156012] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.158017] ** ** [ 0.159010] ** This means that this kernel is built to expose internal ** [ 0.162012] ** IOMMU data structures, which may compromise security on ** [ 0.163008] ** your system. ** [ 0.165009] ** ** [ 0.167007] ** If you see this message and you are not debugging the ** [ 0.169013] ** kernel, report this immediately to your vendor! ** [ 0.172013] ** ** [ 0.175014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.177012] ************************************************************* [ 0.180049] NET: Registered protocol family 16 [ 0.182490] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.185063] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.188071] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.191707] cpuidle: using governor menu [ 0.192647] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.195592] PCI: Using configuration type 1 for base access [ 0.198160] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.206137] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.207018] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.210091] cryptd: max_cpu_qlen set to 1000 [ 0.215171] ACPI: Added _OSI(Module Device) [ 0.218018] ACPI: Added _OSI(Processor Device) [ 0.220013] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.221016] ACPI: Added _OSI(Processor Aggregator Device) [ 0.227558] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.234548] ACPI: Interpreter enabled [ 0.236066] ACPI: PM: (supports S0 S3 S4 S5) [ 0.237012] ACPI: Using IOAPIC for interrupt routing [ 0.239169] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.243432] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.253416] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.256041] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.259016] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.263078] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.267497] acpiphp: Slot [2] registered [ 0.269122] acpiphp: Slot [5] registered [ 0.271122] acpiphp: Slot [6] registered [ 0.273117] acpiphp: Slot [7] registered [ 0.274144] acpiphp: Slot [8] registered [ 0.276114] acpiphp: Slot [9] registered [ 0.277130] acpiphp: Slot [10] registered [ 0.279160] acpiphp: Slot [3] registered [ 0.280208] acpiphp: Slot [4] registered [ 0.281675] acpiphp: Slot [11] registered [ 0.283105] acpiphp: Slot [12] registered [ 0.285121] acpiphp: Slot [13] registered [ 0.287110] acpiphp: Slot [14] registered [ 0.289116] acpiphp: Slot [15] registered [ 0.291116] acpiphp: Slot [16] registered [ 0.292096] acpiphp: Slot [17] registered [ 0.294099] acpiphp: Slot [18] registered [ 0.296120] acpiphp: Slot [19] registered [ 0.298096] acpiphp: Slot [20] registered [ 0.299096] acpiphp: Slot [21] registered [ 0.301117] acpiphp: Slot [22] registered [ 0.303129] acpiphp: Slot [23] registered [ 0.304106] acpiphp: Slot [24] registered [ 0.306092] acpiphp: Slot [25] registered [ 0.308122] acpiphp: Slot [26] registered [ 0.309112] acpiphp: Slot [27] registered [ 0.311123] acpiphp: Slot [28] registered [ 0.313105] acpiphp: Slot [29] registered [ 0.315092] acpiphp: Slot [30] registered [ 0.316084] acpiphp: Slot [31] registered [ 0.318089] PCI host bridge to bus 0000:00 [ 0.320054] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.322027] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.325021] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.328029] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.331062] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.335028] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.337557] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.341278] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.344502] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.354746] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.361010] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.363016] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.365015] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.367019] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.370743] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.373778] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.376047] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.380117] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.385171] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.396016] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.402724] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.406659] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.412017] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.417018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.432013] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.440955] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.446013] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.451014] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.467019] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.481300] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.492016] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.499015] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.519018] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.533856] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.541016] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.548015] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.573015] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.585191] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.593016] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.602015] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.621017] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.631000] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.643016] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.652060] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.692017] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.707000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.710457] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.713407] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.715344] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.717277] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.722041] iommu: Default domain type: Passthrough [ 0.724448] SCSI subsystem initialized [ 0.725110] ACPI: bus type USB registered [ 0.727181] usbcore: registered new interface driver usbfs [ 0.728227] usbcore: registered new interface driver hub [ 0.730075] usbcore: registered new device driver usb [ 0.732159] pps_core: LinuxPPS API ver. 1 registered [ 0.734010] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.736149] PTP clock support registered [ 0.739090] EDAC MC: Ver: 3.0.0 [ 0.740491] PCI: Using ACPI for IRQ routing [ 0.743069] NetLabel: Initializing [ 0.744007] NetLabel: domain hash size = 128 [ 0.745009] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.747138] NetLabel: unlabeled traffic allowed by default [ 0.749324] vgaarb: loaded [ 0.751435] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.753011] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.759321] clocksource: Switched to clocksource kvm-clock [ 0.889935] VFS: Disk quotas dquot_6.6.0 [ 0.891733] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.894991] *** VALIDATE ramfs *** [ 0.896400] *** VALIDATE hugetlbfs *** [ 0.898204] pnp: PnP ACPI init [ 0.903234] pnp: PnP ACPI: found 6 devices [ 0.926025] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.930698] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.933110] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.936101] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.938129] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.941446] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.944447] NET: Registered protocol family 2 [ 0.946954] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.954618] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.958925] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.965241] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.969054] TCP: Hash tables configured (established 65536 bind 65536) [ 0.972178] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.975658] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.978578] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.981446] NET: Registered protocol family 1 [ 0.984440] RPC: Registered named UNIX socket transport module. [ 0.986055] RPC: Registered udp transport module. [ 0.987075] RPC: Registered tcp transport module. [ 0.988675] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.991212] NET: Registered protocol family 44 [ 0.992941] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.995439] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.997813] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.000618] PCI: CLS 0 bytes, default 64 [ 1.002677] Unpacking initramfs... [ 2.562421] debug: unmapping init [mem 0xffff9c1e7cc54000-0xffff9c1e7ffbffff] [ 2.568749] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.570510] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.572760] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.082859] Initialise system trusted keyrings [ 3.084548] Key type blacklist registered [ 3.086403] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.111846] zbud: loaded [ 3.120277] *** VALIDATE nfs *** [ 3.121265] *** VALIDATE nfs4 *** [ 3.122476] pstore: using deflate compression [ 3.126341] Platform Keyring initialized [ 3.236411] NET: Registered protocol family 38 [ 3.238546] Key type asymmetric registered [ 3.240455] Asymmetric key parser 'x509' registered [ 3.244643] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.247966] io scheduler mq-deadline registered [ 3.249928] io scheduler kyber registered [ 3.251922] io scheduler bfq registered [ 3.254232] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.257642] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.260939] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.262709] ACPI: Power Button [PWRF] [ 3.267445] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.272879] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.288420] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.301639] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.318150] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.346766] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.374282] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.377689] Non-volatile memory driver v1.3 [ 3.379376] Linux agpgart interface v0.103 [ 3.412392] virtio_blk virtio1: [vda] 145904 512-byte logical blocks (74.7 MB/71.2 MiB) [ 3.416503] vda: detected capacity change from 0 to 74702848 [ 3.436324] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.438476] vdb: detected capacity change from 0 to 1073741824 [ 3.454787] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.457189] vdc: detected capacity change from 0 to 2621440000 [ 3.478485] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.481446] vdd: detected capacity change from 0 to 2621440000 [ 3.501933] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.505328] vde: detected capacity change from 0 to 4294967296 [ 3.528638] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.530856] vdf: detected capacity change from 0 to 4294967296 [ 3.542244] libphy: Fixed MDIO Bus: probed [ 3.549445] usbcore: registered new interface driver usbserial_generic [ 3.551362] usbserial: USB Serial support registered for generic [ 3.552758] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.555905] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.557630] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.559324] mousedev: PS/2 mouse device common for all mice [ 3.563440] rtc_cmos 00:05: RTC can wake from S4 [ 3.566419] rtc_cmos 00:05: registered as rtc0 [ 3.568154] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.570763] intel_pstate: CPU model not supported [ 3.573019] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.576988] hid: raw HID events driver (C) Jiri Kosina [ 3.579618] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.580796] usbcore: registered new interface driver usbhid [ 3.584439] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.586683] usbhid: USB HID core driver [ 3.592509] drop_monitor: Initializing network drop monitor service [ 3.596527] Initializing XFRM netlink socket [ 3.600329] NET: Registered protocol family 10 [ 3.604062] Segment Routing with IPv6 [ 3.605975] NET: Registered protocol family 17 [ 3.608607] mpls_gso: MPLS GSO support [ 3.615806] RAS: Correctable Errors collector initialized. [ 3.618251] AVX version of gcm_enc/dec engaged. [ 3.619969] AES CTR mode by8 optimization enabled [ 3.750550] sched_clock: Marking stable (3750531659, 0)->(4722887205, -972355546) [ 3.754787] registered taskstats version 1 [ 3.757334] Loading compiled-in X.509 certificates [ 3.759395] zswap: loaded using pool lzo/zbud [ 3.789888] Key type big_key registered [ 3.804602] Key type encrypted registered [ 3.806527] ima: No TPM chip found, activating TPM-bypass! [ 3.808572] ima: Allocated hash algorithm: sha1 [ 3.810574] ima: No architecture policies found [ 3.812640] evm: Initialising EVM extended attributes: [ 3.814742] evm: security.selinux [ 3.816345] evm: security.ima [ 3.817575] evm: security.capability [ 3.819142] evm: HMAC attrs: 0x1 [ 3.821594] rtc_cmos 00:05: setting system clock to 2026-08-19 00:06:54 UTC (1787098014) [ 3.828700] debug: unmapping init [mem 0xffffffff9e403000-0xffffffff9e5fffff] [ 3.832179] debug: unmapping init [mem 0xffffffff9d182000-0xffffffff9d458fff] [ 3.841152] Write protecting the kernel read-only data: 28672k [ 3.844464] debug: unmapping init [mem 0xffffffff9b803000-0xffffffff9b9fffff] [ 3.847548] debug: unmapping init [mem 0xffffffff9c114000-0xffffffff9c1fffff] [ 3.879167] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.885344] systemd[1]: Detected virtualization kvm. [ 3.887844] systemd[1]: Detected architecture x86-64. [ 3.889408] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.915728] systemd[1]: No hostname configured. [ 3.917816] systemd[1]: Set hostname to . [ 3.920384] random: systemd: uninitialized urandom read (16 bytes read) [ 3.923138] systemd[1]: Initializing machine ID from random generator. [ 4.068664] random: systemd: uninitialized urandom read (16 bytes read) [ 4.071463] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.075389] random: systemd: uninitialized urandom read (16 bytes read) [ 4.078195] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.093637] systemd[1]: Starting Apply Kernel Variables... Starting Apply Kernel Variables... Starting Setup Virtual Console... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Timers. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target Local File Systems. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Swap. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. Starting Create Volatile Files and Directories... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.765208] device-mapper: uevent: version 1.0.3 [ 4.768648] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ 5.615426] random: fast init done [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.755308] virtio_net virtio0 ens2: renamed from eth0 [ 6.040751] scsi host0: ata_piix [ 6.084635] scsi host1: ata_piix [ 6.121333] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 6.123471] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 10.334953] random: crng init done [ 10.336460] random: 7 urandom warning(s) missed due to ratelimiting [ 10.350030] dracut-initqueue[584]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 11.688143] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 13.253202] printk: systemd: 26 output lines suppressed due to ratelimiting [ 13.674292] SELinux: Disabled at runtime. [ 13.753163] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 13.765659] systemd[1]: Detected virtualization kvm. [ 13.768197] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 14.316132] systemd[1]: initrd-switch-root.service: Succeeded. [ 14.318316] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 14.322606] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 14.325626] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 14.331121] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 14.345627] systemd[1]: Starting Journal Service... Starting Journal Service... [ 14.359868] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... Mounting POSIX Message Queue File System... [ OK ] Listening on Process Core Dump Socket. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-serial\x2dgetty.slice. Starting Create list of required st…ce nodes for the current kernel... Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Reached target Slices. Mounting Huge Pages File System... [ OK [ 14.521423] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target Paths. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Mounting Kernel Debug File System... Starting Apply Kernel Variables... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-getty.slice. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Configure read-only root support... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ 15.089262] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /mnt. [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 15.786509] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 15.826527] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 16.210191] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 16.223972] EDAC sbridge: Ver: 1.1.2 [ 18.123052] Key type dns_resolver registered [ 18.456807] NFS: Registering the id_resolver key type [ 18.458642] Key type id_resolver registered [ 18.459962] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started RPC Bind. [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Login Service... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Started OpenSSH server daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg152-server login: [ 30.475053] hrtimer: interrupt took 2654513 ns [ 67.878160] libcfs: loading out-of-tree module taints kernel. [ 67.927625] Key type ._llcrypt registered [ 67.930459] Key type .llcrypt registered [ 68.029367] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 85.926529] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 87.539580] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 87.551932] alg: No test for adler32 (adler32-zlib) [ 89.056978] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 89.754401] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 91.562403] Key type lgssc registered [ 94.151525] Lustre: Echo OBD driver; http://www.lustre.org/ [ 110.327542] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 153.442497] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 167.135733] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 167.184144] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 168.505083] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 168.533382] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 168.666784] Lustre: lustre-MDT0000: new disk, initializing [ 168.749474] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 168.786099] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 173.516642] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 187.758385] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 187.896896] Lustre: 6510:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 187.940772] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 187.944954] Lustre: Skipped 1 previous similar message [ 188.121560] Lustre: lustre-MDT0001: new disk, initializing [ 188.237040] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 188.275865] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 188.295795] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 193.170264] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 198.295071] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 209.179032] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 209.641715] Lustre: lustre-OST0000: new disk, initializing [ 209.649250] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 209.659108] Lustre: 8448:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 209.732406] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 210.171519] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 210.196111] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 210.364056] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 218.557245] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 237.915567] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 238.146624] Lustre: lustre-OST0001: new disk, initializing [ 238.151908] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 238.163320] Lustre: 9522:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 238.277795] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 245.306547] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 245.327875] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 245.391716] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 245.907944] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 259.404705] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 268.938510] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 278.036471] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing check_logdir /tmp/testlogs/ [ 285.738496] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing yml_node [ 290.282370] Lustre: DEBUG MARKER: Client: 2.17.57.1 [ 293.075906] Lustre: DEBUG MARKER: MDS: 2.17.57.1 [ 295.910648] Lustre: DEBUG MARKER: OSS: 2.17.57.1 [ 297.529306] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Aug 18 20:11:46 EDT 2026 [ 315.252436] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 317.013297] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 336.865764] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 336.875440] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 336.899351] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 337.379750] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 337.403383] Lustre: Skipped 2 previous similar messages [ 337.408868] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 337.419931] Lustre: Skipped 3 previous similar messages [ 342.094772] Lustre: server umount lustre-MDT0000 complete [ 346.344323] LustreError: 6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098357 with bad export cookie 395616639721816252 [ 346.360239] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 346.379759] LustreError: 6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 347.621398] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 347.623242] LustreError: 6517:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 347.643032] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 347.667939] LustreError: 6517:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 347.698665] Lustre: Skipped 1 previous similar message [ 351.648791] LustreError: 6517:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 351.652070] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 351.671619] Lustre: Skipped 1 previous similar message [ 352.958656] Lustre: server umount lustre-MDT0001 complete [ 357.701920] Lustre: server umount lustre-OST0000 complete [ 361.838569] Lustre: server umount lustre-OST0001 complete [ 368.953362] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 378.143486] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 415.965077] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 416.145237] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 416.204484] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 416.371906] Lustre: lustre-MDT0000: new disk, initializing [ 416.489511] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 416.513214] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 421.965221] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 434.249174] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 434.364679] Lustre: 15078:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 434.455736] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 434.458760] Lustre: Skipped 1 previous similar message [ 434.562909] Lustre: lustre-MDT0001: new disk, initializing [ 434.675308] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 434.711283] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 434.723566] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 439.107645] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 448.719553] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 455.116822] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 463.062951] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 463.388453] Lustre: lustre-OST0000: new disk, initializing [ 463.392459] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 463.409985] Lustre: 17046:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 463.558305] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 464.869440] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 464.886506] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 465.041735] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 470.953242] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 481.262132] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 486.745416] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 487.094437] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 492.378253] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 492.683413] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 495.604418] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 495.604955] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 495.611576] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 495.618295] Lustre: Skipped 2 previous similar messages [ 495.624287] Lustre: Skipped 1 previous similar message [ 505.831139] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 505.845109] Lustre: Skipped 3 previous similar messages [ 508.896149] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 509.240983] Lustre: server umount lustre-OST0000 complete [ 516.084051] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 516.108274] Lustre: Skipped 1 previous similar message [ 519.729706] Lustre: server umount lustre-MDT0000 complete [ 521.186931] LustreError: 15968:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 521.198275] LustreError: 15968:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 523.430166] LustreError: 15067:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098534 with bad export cookie 395616639721817785 [ 523.435723] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 523.440104] LustreError: 15067:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 523.780627] Lustre: server umount lustre-MDT0001 complete [ 529.417993] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 20:15:38 (1787098538) [ 535.899168] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 536.345926] LustreError: 19312:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 536.419393] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 540.884455] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 541.665280] LustreError: 19313:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 550.145859] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 555.182481] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 563.285762] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 570.089990] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 577.379973] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 584.824388] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 593.159088] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 600.501641] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 611.814650] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 611.819553] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 611.826212] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 611.826222] Lustre: Skipped 2 previous similar messages [ 611.828137] Lustre: Skipped 1 previous similar message [ 611.850691] LustreError: Skipped 1 previous similar message [ 613.779816] Lustre: server umount lustre-MDT0000 complete [ 616.932123] LustreError: 19312:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 616.965551] LustreError: 19312:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 617.967205] LustreError: 19294:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098628 with bad export cookie 395616639721818660 [ 617.989307] LustreError: 19294:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 617.992945] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 618.493563] Lustre: server umount lustre-MDT0001 complete [ 633.111934] Lustre: server umount lustre-OST0000 complete [ 655.313502] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 666.720255] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 667.204403] LustreError: 23695:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 667.338231] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 667.347579] Lustre: Skipped 2 previous similar messages [ 673.109644] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 682.513466] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 688.075268] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 691.162157] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 698.888204] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 705.889752] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 714.952682] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 715.178936] Lustre: lustre-OST0001: new disk, initializing [ 715.184866] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 715.193750] Lustre: 26010:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 716.717343] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 716.740347] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 716.873135] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 724.558811] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 735.560853] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 739.702666] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 752.614501] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 752.621292] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 752.636186] Lustre: Skipped 4 previous similar messages [ 752.644266] Lustre: Skipped 5 previous similar messages [ 758.823593] Lustre: server umount lustre-MDT0000 complete [ 762.854709] LustreError: 23695:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 762.870556] LustreError: 23695:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 763.170152] LustreError: 24835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098773 with bad export cookie 395616639721819514 [ 763.183282] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 763.798550] Lustre: server umount lustre-MDT0001 complete [ 778.987330] Lustre: server umount lustre-OST0000 complete [ 793.496658] Lustre: server umount lustre-OST0001 complete [ 811.288504] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 821.206605] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 821.633912] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 821.638627] Lustre: Skipped 3 previous similar messages [ 826.569605] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 831.972888] LustreError: 29033:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 832.011461] LustreError: 29033:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 835.983596] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 841.019636] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 844.452940] Lustre: 30181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 851.965727] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 860.173187] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 870.443163] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 878.384654] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 886.333119] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 889.891679] Lustre: 32060:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 896.492371] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 896.499594] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 896.509792] Lustre: Skipped 3 previous similar messages [ 896.514794] Lustre: Skipped 6 previous similar messages [ 902.235202] Lustre: server umount lustre-MDT0000 complete [ 907.568833] LustreError: 30183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098918 with bad export cookie 395616639721820809 [ 907.575751] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 907.592771] LustreError: 30183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 908.316251] Lustre: server umount lustre-MDT0001 complete [ 924.169181] Lustre: server umount lustre-OST0000 complete [ 928.253543] Lustre: 3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787098922/real 1787098922] req@ffff9c1dc129ca80 x1873908177618560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787098938 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 929.017250] Lustre: server umount lustre-OST0001 complete [ 937.695438] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 20:22:26 (1787098946) [ 965.004888] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 975.121159] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 975.447577] LustreError: 34863:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 975.468174] LustreError: 34863:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 8 previous similar messages [ 980.423638] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 990.709268] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 996.200866] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 999.657666] Lustre: 36014:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1006.025606] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1012.607189] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1020.928684] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1027.867648] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1034.853747] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1038.827646] Lustre: 37891:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1047.012850] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1047.023180] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1047.029558] Lustre: Skipped 3 previous similar messages [ 1047.045071] Lustre: Skipped 8 previous similar messages [ 1049.966536] Lustre: server umount lustre-MDT0000 complete [ 1053.022762] LustreError: 37893:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787099063 with bad export cookie 395616639721821915 [ 1053.034198] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1053.547899] Lustre: server umount lustre-MDT0001 complete [ 1068.048702] Lustre: server umount lustre-OST0000 complete [ 1082.336241] Lustre: server umount lustre-OST0001 complete [ 1090.900271] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 20:24:59 (1787099099) [ 1107.155705] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 1116.940308] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1117.475241] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1117.489770] Lustre: Skipped 7 previous similar messages [ 1121.381859] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1129.507773] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1135.485485] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1138.925744] Lustre: 41182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1145.276236] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1151.475312] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1159.665887] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1165.960436] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1172.754110] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1176.401882] Lustre: 43061:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1177.295456] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1177.298144] Lustre: Skipped 1 previous similar message [ 1181.153710] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1181.158714] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1181.174487] Lustre: Skipped 1 previous similar message [ 1186.207586] Lustre: server umount lustre-MDT0000 complete [ 1189.978127] LustreError: 40013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787099200 with bad export cookie 395616639721823021 [ 1190.001453] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1190.002795] LustreError: 40013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 1196.453366] Lustre: server umount lustre-MDT0001 complete [ 1204.931179] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1220.381651] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1225.271400] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1230.740499] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1236.466179] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1236.476719] Lustre: Skipped 1 previous similar message [ 1236.583711] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1244.824888] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1246.741384] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1253.264604] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1254.875636] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1262.058426] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1266.264968] Lustre: server umount lustre-MDT0000 complete [ 1267.170214] LustreError: 43937:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1267.198874] LustreError: 43937:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 34 previous similar messages [ 1270.352291] LustreError: 42371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787099281 with bad export cookie 395616639721824148 [ 1270.352802] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1270.365052] LustreError: 42371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1270.765699] Lustre: server umount lustre-MDT0001 complete [ 1285.235657] Lustre: server umount lustre-OST0000 complete [ 1288.160703] Lustre: 3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787099282/real 1787099282] req@ffff9c1efef1a680 x1873908177754240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787099298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1290.614433] Lustre: server umount lustre-OST0001 complete [ 1301.319529] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 20:28:29 (1787099309) [ 1317.907560] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 1328.973317] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1333.897770] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1343.231738] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1348.169370] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1351.123152] Lustre: 48824:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1359.107938] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1367.474554] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1378.233627] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1384.584671] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1392.768476] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1397.491318] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1409.522140] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1409.530853] Lustre: Skipped 18 previous similar messages [ 1410.729313] Lustre: server umount lustre-MDT0000 complete [ 1414.569897] LustreError: 47651:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787099425 with bad export cookie 395616639721824939 [ 1414.579823] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1414.588579] LustreError: 47651:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1415.006808] Lustre: server umount lustre-MDT0001 complete [ 1421.427846] Lustre: server umount lustre-OST0000 complete [ 1424.588129] Lustre: server umount lustre-OST0001 complete [ 1434.460568] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 20:30:43 (1787099443) [ 1436.684449] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1438.396190] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 20:30:47 (1787099447) [ 1448.725815] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 1457.496952] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 1478.776545] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1479.081705] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1479.163583] Lustre: lustre-MDT0000: new disk, initializing [ 1479.309962] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1484.148477] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1493.413586] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1499.700511] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1499.912465] Lustre: lustre-OST0000: new disk, initializing [ 1499.914643] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1499.917430] Lustre: Skipped 1 previous similar message [ 1499.920430] Lustre: 54894:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1501.854173] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1501.858853] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1501.886988] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1505.797612] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1518.835385] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1521.641857] Lustre: DEBUG MARKER: create test files [ 1553.379806] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1553.383122] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1553.399872] Lustre: Skipped 16 previous similar messages [ 1555.968688] Lustre: server umount lustre-OST0000 complete [ 1559.500084] Lustre: server umount lustre-MDT0000 complete [ 1569.779553] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 1572.966783] Key type lgssc unregistered [ 1573.292039] LNet: 56528:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1573.296465] LNetError: 56528:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1573.320020] LNet: Removed LNI 192.168.201.152@tcp [ 1574.113291] Key type .llcrypt unregistered [ 1574.114984] Key type ._llcrypt unregistered [ 1604.383706] Key type ._llcrypt registered [ 1604.386371] Key type .llcrypt registered [ 1604.482450] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 1605.730484] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1605.752204] alg: No test for adler32 (adler32-zlib) [ 1606.743342] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 1607.025188] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 1608.816216] Key type lgssc registered [ 1610.136509] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1618.312988] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1618.332395] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1619.843439] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1624.717185] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1631.309996] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1637.158520] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1637.517711] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1643.993540] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1644.726105] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1644.882878] Lustre: 59264:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1644.892246] Lustre: 59264:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1644.899487] Lustre: 59264:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1644.906114] Lustre: 59264:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1644.917478] Lustre: 59264:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1644.925735] Lustre: 59264:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1650.907286] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1655.754500] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1660.723146] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1670.633450] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1670.649950] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1670.822363] Lustre: server umount lustre-OST0000 complete [ 1677.744868] Lustre: server umount lustre-MDT0000 complete [ 1693.286704] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 1696.102487] Key type lgssc unregistered [ 1696.353083] LNet: 60877:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1696.358193] LNetError: 60877:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1696.377903] LNet: Removed LNI 192.168.201.152@tcp [ 1697.636138] Key type .llcrypt unregistered [ 1697.638719] Key type ._llcrypt unregistered [ 1729.897772] Key type ._llcrypt registered [ 1729.906100] Key type .llcrypt registered [ 1729.996502] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 1730.815138] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1731.028485] alg: No test for adler32 (adler32-zlib) [ 1732.034216] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 1732.186306] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 1733.904693] Key type lgssc registered [ 1735.826828] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1743.460813] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1743.479964] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1745.012560] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1750.321736] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1758.945154] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1766.114270] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1766.430778] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1769.545275] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1769.614917] Lustre: 63730:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1769.619948] Lustre: 63730:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1769.624650] Lustre: 63730:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1769.640700] Lustre: 63730:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1769.647880] Lustre: 63730:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1769.656109] Lustre: 63730:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1772.484254] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1780.316710] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1785.733629] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1795.055097] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1795.066847] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1795.083982] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1800.166338] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1800.874210] Lustre: server umount lustre-OST0000 complete [ 1806.042266] Lustre: server umount lustre-MDT0000 complete [ 1820.090409] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 1825.052716] Key type lgssc unregistered [ 1825.288137] LNet: 65291:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1825.301621] LNetError: 65291:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1825.339780] LNet: Removed LNI 192.168.201.152@tcp [ 1826.820986] Key type .llcrypt unregistered [ 1826.828863] Key type ._llcrypt unregistered [ 1848.416361] Key type ._llcrypt registered [ 1848.417786] Key type .llcrypt registered [ 1848.562492] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 1867.017711] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 1868.172127] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1868.213950] alg: No test for adler32 (adler32-zlib) [ 1869.637803] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 1869.841745] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 1871.528446] Key type lgssc registered [ 1873.317601] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1912.168248] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1912.190833] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1913.494485] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1913.543582] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1913.629246] Lustre: lustre-MDT0000: new disk, initializing [ 1913.739829] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1913.757532] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1918.477425] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1931.203269] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1931.288631] Lustre: 68444:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1931.349095] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1931.365705] Lustre: Skipped 1 previous similar message [ 1931.432491] Lustre: lustre-MDT0001: new disk, initializing [ 1931.541404] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1931.585151] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1931.593194] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1937.355968] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1949.773209] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1956.633910] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1964.001452] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1964.354954] Lustre: lustre-OST0000: new disk, initializing [ 1964.362069] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1964.375536] Lustre: 70414:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1964.522754] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1971.346596] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 1972.324369] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1972.339298] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1972.546533] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1981.334789] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1987.182443] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1987.428796] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1993.470199] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1993.866895] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1998.307838] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1998.318380] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1998.326852] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1998.371880] Lustre: Skipped 1 previous similar message [ 2002.651331] Lustre: server umount lustre-OST0000 complete [ 2008.547826] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2008.549370] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2008.550432] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2008.550437] Lustre: Skipped 1 previous similar message [ 2008.576389] Lustre: Skipped 1 previous similar message [ 2013.617754] Lustre: server umount lustre-MDT0000 complete [ 2017.447487] LustreError: 69239:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787100028 with bad export cookie 17528066627583635781 [ 2017.463039] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2018.084890] Lustre: server umount lustre-MDT0001 complete [ 2026.666486] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 20:40:35 (1787100035) [ 2040.289733] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 2088.280300] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 2099.719939] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 2144.132742] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2144.385429] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2144.411182] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2144.513940] Lustre: lustre-MDT0000: new disk, initializing [ 2144.603618] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2144.626721] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2150.711756] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2162.643938] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2162.776490] Lustre: 76437:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2162.834667] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2162.837510] Lustre: Skipped 1 previous similar message [ 2162.891371] Lustre: lustre-MDT0001: new disk, initializing [ 2162.994178] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2163.023753] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2163.030451] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2168.317574] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2179.480511] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2186.954191] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2194.660044] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2195.105649] Lustre: lustre-OST0000: new disk, initializing [ 2195.109312] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2195.115083] Lustre: 78409:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2195.276714] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2201.665269] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2201.679534] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2201.788630] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2202.139867] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2212.962281] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2218.402958] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2218.693523] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2224.652738] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2224.977640] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2227.696739] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2227.700377] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2227.706536] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2227.706546] Lustre: Skipped 1 previous similar message [ 2227.744767] Lustre: Skipped 1 previous similar message [ 2232.812449] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2232.826499] Lustre: Skipped 2 previous similar messages [ 2233.388695] Lustre: server umount lustre-OST0000 complete [ 2237.939387] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2237.956975] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2243.806678] Lustre: server umount lustre-MDT0000 complete [ 2248.020870] LustreError: 76427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787100258 with bad export cookie 17528066627583636663 [ 2248.023055] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2248.039303] LustreError: 76427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 2248.300013] Lustre: server umount lustre-MDT0001 complete [ 2256.740568] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 20:44:25 (1787100265) [ 2264.548473] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2265.140867] LustreError: 80822:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2265.165489] LustreError: 80822:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2265.217867] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2270.690991] LustreError: 80823:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2271.402612] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2274.786343] LustreError: 80822:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2279.369775] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2284.159886] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2292.219599] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2299.742883] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2306.861117] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2307.253119] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2307.258957] Lustre: Skipped 1 previous similar message [ 2314.308643] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2323.134958] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2327.019194] Lustre: 83495:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 86dba537-c5ce-4c43-ac94-9d3fa2b7105e at adminstrative request [ 2330.103675] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2330.123202] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2340.327200] Lustre: MGS: Client 86dba537-c5ce-4c43-ac94-9d3fa2b7105e (at 0@lo) reconnecting [ 2340.347077] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xf34033bae8807829 to 0xf34033bae8807ac9 [ 2340.372491] Lustre: MGC192.168.201.152@tcp: Connection restored to 0@lo (at 0@lo) [ 2368.184825] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2368.366183] Lustre: lustre-OST0001: new disk, initializing [ 2368.369982] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2368.375292] Lustre: 83890:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2375.610507] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2376.462791] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2376.471085] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2376.652789] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2387.009669] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2392.035393] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2392.047384] LustreError: Skipped 1 previous similar message [ 2392.060884] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2392.082623] Lustre: Skipped 1 previous similar message [ 2392.087992] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2392.093803] Lustre: Skipped 4 previous similar messages [ 2396.374498] Lustre: server umount lustre-OST0001 complete [ 2397.176524] LustreError: 84280:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2397.203316] LustreError: 84280:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2401.768315] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2401.783617] LustreError: Skipped 1 previous similar message [ 2401.785905] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2401.810157] Lustre: Skipped 1 previous similar message [ 2402.275186] LustreError: 84280:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2402.312951] LustreError: 84280:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2407.879633] Lustre: server umount lustre-OST0000 complete [ 2417.639122] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2417.654173] Lustre: Skipped 4 previous similar messages [ 2420.051657] Lustre: server umount lustre-MDT0000 complete [ 2422.754105] LustreError: 80817:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2422.773494] LustreError: 80817:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 2424.303944] LustreError: 80804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787100434 with bad export cookie 17528066627583638217 [ 2424.306842] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2424.318070] LustreError: 80804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2424.710932] Lustre: server umount lustre-MDT0001 complete [ 2435.301621] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 20:47:24 (1787100444) [ 2436.853584] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2438.449942] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 20:47:27 (1787100447) [ 2440.233683] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2441.927817] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 20:47:30 (1787100450) [ 2443.419214] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2445.126616] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 20:47:34 (1787100454) [ 2446.432162] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2448.961618] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 20:47:37 (1787100457) [ 2451.553756] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2459.659657] loop: module loaded [ 2459.698319] loop0: detected capacity change from 0 to 4294967296 [ 2459.764175] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2461.518795] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2466.493111] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2472.374486] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2507.875528] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2507.915960] LustreError: 88017:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2507.920046] LustreError: 88017:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2507.925202] LustreError: 88017:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2507.929620] LustreError: 88017:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2528.820495] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 2543.017191] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 2580.243405] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2580.403747] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2580.430168] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2580.491135] Lustre: lustre-MDT0000: new disk, initializing [ 2580.566729] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2580.570649] Lustre: Skipped 1 previous similar message [ 2580.582672] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2584.908965] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2597.555053] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2597.749537] Lustre: 90884:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2598.054191] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2603.381392] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2614.794530] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2622.371369] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2629.428180] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2629.765580] Lustre: 92854:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2635.416432] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2635.560217] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2637.179865] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2647.641541] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2653.206359] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2653.430590] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2659.131251] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2659.470611] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2666.474096] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2666.476373] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2666.483480] LustreError: Skipped 1 previous similar message [ 2666.484156] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2666.546738] Lustre: Skipped 4 previous similar messages [ 2668.567457] Lustre: server umount lustre-OST0000 complete [ 2680.577769] Lustre: server umount lustre-MDT0000 complete [ 2681.830169] LustreError: 90894:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2681.846414] LustreError: 90894:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2684.121286] LustreError: 90874:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787100694 with bad export cookie 17528066627583638833 [ 2684.138533] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2684.138534] LustreError: 90874:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2684.524800] Lustre: server umount lustre-MDT0001 complete [ 2693.354920] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 20:51:42 (1787100702) [ 2699.860158] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2705.667901] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2714.603908] LustreError: 95267:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2714.632289] LustreError: 95267:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2715.481050] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2716.155355] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 2716.173980] Lustre: Skipped 3 previous similar messages [ 2722.508383] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2731.013812] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2737.376344] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2743.660913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2750.177989] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2757.490910] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2761.896892] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2762.119616] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2766.713067] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2766.993953] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2773.446361] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2773.658760] Lustre: lustre-OST0001: new disk, initializing [ 2773.660937] Lustre: Skipped 2 previous similar messages [ 2773.663954] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2773.667097] Lustre: Skipped 3 previous similar messages [ 2773.671126] Lustre: 98638:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2781.453051] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2781.468266] Lustre: Skipped 2 previous similar messages [ 2781.491812] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2781.643900] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2781.966424] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2796.710574] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2803.958381] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2804.387759] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2811.859042] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2812.233982] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2835.533178] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2866.372458] Lustre: Failing over lustre-MDT0000 [ 2866.780375] Lustre: server umount lustre-MDT0000 complete [ 2866.993332] LustreError: 96701:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.52@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2867.008968] LustreError: 96701:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2868.717594] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2868.738582] Lustre: Skipped 4 previous similar messages [ 2884.560496] Lustre: 66668:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787100879/real 1787100879] req@00000000e4227074 x1873910044060928/t0(0) o400->MGC192.168.201.152@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787100895 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2884.604698] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2894.652306] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2894.654389] LDISKFS-fs (dm-0): recovery complete [ 2894.661057] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2895.847254] LustreError: 66666:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@000000009311b5fe x1873910044068992/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2896.232363] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2897.696750] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2897.697128] Lustre: 95264:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2901.491205] Lustre: 95267:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2901.507382] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2901.524048] Lustre: 95267:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 1 previous similar message [ 2901.669408] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2901.883948] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 2901.996380] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2902.338709] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2902.359876] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 1 previous similar message [ 2902.699580] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2902.703088] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 1 previous similar message [ 2902.718371] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2902.735186] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 7 previous similar messages [ 2903.401500] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2903.416789] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 2 previous similar messages [ 2903.739120] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2903.751641] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 2 previous similar messages [ 2904.737091] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2904.770377] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 5 previous similar messages [ 2905.418817] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2905.440072] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 5 previous similar messages [ 2905.768075] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2905.771739] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 5 previous similar messages [ 2908.955805] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2908.972815] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 12 previous similar messages [ 2909.624889] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2909.639517] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 12 previous similar messages [ 2909.960132] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2909.968828] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 12 previous similar messages [ 2916.969361] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2916.977064] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 24 previous similar messages [ 2917.922841] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2917.937850] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 25 previous similar messages [ 2918.264423] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2918.268464] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 25 previous similar messages [ 2933.192291] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2933.204850] Lustre: 101488:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 50 previous similar messages [ 2934.161197] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2934.174183] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 50 previous similar messages [ 2934.504134] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2934.513847] LustreError: 101488:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 50 previous similar messages [ 2957.305163] Lustre: 101488:0:(ldlm_lib.c:2394:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2957.316049] Lustre: 101488:0:(ldlm_lib.c:2404:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2957.321328] Lustre: 101488:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 8366acab-f941-4f78-8315-b2d7a0e4ae0d@192.168.201.52@tcp [ 2957.338669] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2957.344805] Lustre: 101488:0:(ldlm_lib.c:1914:abort_req_replay_queue()) @@@ aborted: req@00000000b4bbd5c7 x1873910024966528/t0(8589934771) o101->8366acab-f941-4f78-8315-b2d7a0e4ae0d@192.168.201.52@tcp:123/0 lens 592/0 e 0 to 0 dl 1787100978 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2957.378116] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2957.395933] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2957.409868] Lustre: lustre-MDT0000: Denying connection for new client 8366acab-f941-4f78-8315-b2d7a0e4ae0d (at 192.168.201.52@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2957.440624] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2957.440633] Lustre: Skipped 2 previous similar messages [ 2957.448225] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2957.485796] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 2957.486163] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:545) [ 2968.041340] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2968.046734] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2968.046743] Lustre: Skipped 4 previous similar messages [ 2968.055049] Lustre: Skipped 2 previous similar messages [ 2972.888379] Lustre: server umount lustre-OST0000 complete [ 2976.234693] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2976.238628] LustreError: Skipped 1 previous similar message [ 2982.109784] Lustre: server umount lustre-OST0001 complete [ 2999.264242] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2999.418546] Lustre: server umount lustre-MDT0000 complete [ 3002.761364] LustreError: 95248:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101013 with bad export cookie 17528066627583690045 [ 3002.764704] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3002.769348] LustreError: 95248:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3003.065466] Lustre: server umount lustre-MDT0001 complete [ 3010.484976] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 20:56:59 (1787101019) [ 3015.737537] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3015.744701] Lustre: *** cfs_fail_loc=197, val=0*** [ 3031.200623] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3036.320412] LustreError: 103461:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.152@tcp: failed processing log, type 4: rc = -110 [ 3041.469444] Lustre: *** cfs_fail_loc=197, val=0*** [ 3041.476295] Lustre: Skipped 65 previous similar messages [ 3062.048998] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3062.056618] Lustre: Skipped 3 previous similar messages [ 3066.491056] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3071.554499] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3072.748894] Lustre: server umount lustre-OST0000 complete [ 3078.627724] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 20:58:08 (1787101088) [ 3096.249742] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3096.593934] LustreError: 105079:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3096.603733] LustreError: 105079:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 44 previous similar messages [ 3099.790534] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3106.712683] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3109.967198] LustreError: 105111:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3109.976902] LustreError: 105111:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3109.983235] LustreError: 105111:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 13, retries 0, failed: rc = -5 [ 3110.291388] Lustre: server umount lustre-MDT0000 complete [ 3132.937419] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 3139.755497] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3164.257880] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3164.445047] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3164.460989] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3164.523226] Lustre: lustre-MDT0000: new disk, initializing [ 3164.602309] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3167.097345] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3174.566153] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3174.645950] Lustre: 109279:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3174.801194] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3177.980237] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3184.056505] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3187.383940] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3192.985499] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3193.151485] Lustre: 111249:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3196.864669] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3198.539785] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3202.262060] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3204.471175] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3204.583347] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3207.027799] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3207.160340] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3208.681880] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3208.683699] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3208.691840] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3208.691848] Lustre: Skipped 10 previous similar messages [ 3208.696026] LustreError: Skipped 2 previous similar messages [ 3208.702148] Lustre: Skipped 5 previous similar messages [ 3214.525958] Lustre: server umount lustre-OST0000 complete [ 3231.200134] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3231.327377] Lustre: server umount lustre-MDT0000 complete [ 3233.814524] LustreError: 109271:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101244 with bad export cookie 17528066627583700594 [ 3233.816482] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3233.828485] LustreError: 109271:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3234.040268] Lustre: server umount lustre-MDT0001 complete [ 3240.063757] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 21:00:49 (1787101249) [ 3246.736918] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 3248.647618] Key type lgssc unregistered [ 3248.889982] LNet: 113736:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3248.903134] LNetError: 113736:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3248.917218] LNet: Removed LNI 192.168.201.152@tcp [ 3249.567949] Key type .llcrypt unregistered [ 3249.570704] Key type ._llcrypt unregistered [ 3261.149957] Key type ._llcrypt registered [ 3261.151776] Key type .llcrypt registered [ 3261.212053] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 3271.496631] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3272.083222] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3272.196156] alg: No test for adler32 (adler32-zlib) [ 3273.169973] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 3273.378658] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 3275.027581] Key type lgssc registered [ 3275.724480] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3302.162397] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3302.186522] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3303.377443] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3303.405678] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3303.458470] Lustre: lustre-MDT0000: new disk, initializing [ 3303.501988] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3303.514241] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3305.902606] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3312.973969] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3313.126442] Lustre: lustre-OST0000: new disk, initializing [ 3313.128991] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3313.131291] Lustre: Skipped 1 previous similar message [ 3313.133859] Lustre: 117897:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3313.171800] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3314.316724] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3314.327160] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3314.348713] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3316.541619] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3322.847852] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3322.936646] Lustre: lustre-OST0001: new disk, initializing [ 3322.938748] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3322.942176] Lustre: 118763:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3322.983125] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3323.524460] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3323.529936] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3323.552109] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3325.908951] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3334.117747] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3334.119174] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3334.126716] Lustre: Skipped 1 previous similar message [ 3334.134732] Lustre: Skipped 1 previous similar message [ 3338.416063] Lustre: server umount lustre-MDT0000 complete [ 3342.862649] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3346.045983] LustreError: 117085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101356 with bad export cookie 7614439555540134792 [ 3346.051840] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3346.125365] Lustre: server umount lustre-OST0000 complete [ 3348.769679] Lustre: server umount lustre-OST0001 complete [ 3354.411479] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 21:02:43 (1787101363) [ 3369.534186] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 21:02:58 (1787101378) [ 3375.150230] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3389.575767] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 21:03:19 (1787101399) [ 3411.676028] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 3417.608637] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3440.545496] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3440.699184] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3440.720248] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3440.765473] Lustre: lustre-MDT0000: new disk, initializing [ 3440.840103] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3440.850845] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3443.715466] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3451.408625] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3451.458432] Lustre: 126502:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3451.484918] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3451.487661] Lustre: Skipped 1 previous similar message [ 3451.535101] Lustre: lustre-MDT0001: new disk, initializing [ 3451.592505] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3451.624775] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3451.633346] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3453.981263] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3459.674169] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3463.600814] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3467.569691] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3467.717297] Lustre: lustre-OST0000: new disk, initializing [ 3467.719243] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3467.722821] Lustre: 128470:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3467.767930] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3470.913686] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3476.529137] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3476.533921] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3476.584935] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3477.663502] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3480.465825] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3480.635371] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3483.390895] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3483.516837] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3486.692813] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3486.693033] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3486.710292] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3486.722438] Lustre: Skipped 1 previous similar message [ 3491.812947] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3491.817186] Lustre: Skipped 1 previous similar message [ 3496.933416] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3496.938972] Lustre: Skipped 1 previous similar message [ 3498.976351] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3499.098902] Lustre: server umount lustre-OST0000 complete [ 3503.077101] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3503.085292] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3503.094022] Lustre: Skipped 1 previous similar message [ 3503.097877] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3507.175934] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3508.454866] Lustre: server umount lustre-MDT0000 complete [ 3511.274572] LustreError: 126496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101521 with bad export cookie 7614439555540136017 [ 3511.275898] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3511.279107] LustreError: 126496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3511.644128] Lustre: server umount lustre-MDT0001 complete [ 3518.098129] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 21:05:27 (1787101527) [ 3523.357831] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3523.683717] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3526.274090] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3529.185673] LustreError: 130883:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3529.194811] LustreError: 130883:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3531.749152] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3534.567566] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3539.138784] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3542.474454] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3546.762303] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3550.781611] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3555.501457] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3562.298554] Lustre: *** cfs_fail_loc=159, val=0*** [ 3578.688528] Lustre: lustre-MDT0000: Client c7650096-3b09-480f-a20a-aaa25da5a5e3 (at 192.168.201.52@tcp) reconnecting [ 3579.662061] Lustre: *** cfs_fail_loc=159, val=0*** [ 3579.666339] Lustre: Skipped 5 previous similar messages [ 3596.089370] Lustre: lustre-MDT0000: Client c7650096-3b09-480f-a20a-aaa25da5a5e3 (at 192.168.201.52@tcp) reconnecting [ 3598.305124] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3598.309942] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3598.314259] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3598.323036] Lustre: Skipped 1 previous similar message [ 3598.326478] Lustre: Skipped 2 previous similar messages [ 3604.343566] Lustre: server umount lustre-OST0000 complete [ 3608.546399] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3608.552150] Lustre: Skipped 1 previous similar message [ 3612.463518] Lustre: server umount lustre-MDT0000 complete [ 3613.665087] LustreError: 130884:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3613.677945] LustreError: 130884:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3614.244299] LustreError: 130863:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101624 with bad export cookie 7614439555540136906 [ 3614.247104] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3614.249327] LustreError: 130863:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3614.437976] Lustre: server umount lustre-MDT0001 complete [ 3621.362811] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 3622.838392] Key type lgssc unregistered [ 3623.016579] LNet: 134657:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3623.023466] LNetError: 134657:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3623.035499] LNet: Removed LNI 192.168.201.152@tcp [ 3623.489096] Key type .llcrypt unregistered [ 3623.490864] Key type ._llcrypt unregistered [ 3636.425487] Key type ._llcrypt registered [ 3636.427232] Key type .llcrypt registered [ 3636.483975] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3636.989037] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3637.073929] alg: No test for adler32 (adler32-zlib) [ 3638.021799] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 3638.179355] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 3639.784212] Key type lgssc registered [ 3640.325227] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3644.371058] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3644.385878] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3645.642127] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3647.768426] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3652.757545] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3653.034562] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3655.339768] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3659.414414] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3662.484523] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3666.053760] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3666.265187] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3669.547549] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3670.390634] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3673.414395] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3683.740663] Lustre: *** cfs_fail_loc=159, val=0*** [ 3700.024886] Lustre: lustre-MDT0000: Client 02c4a7da-508f-44d8-978f-58ef966011bd (at 192.168.201.52@tcp) reconnecting [ 3701.526409] Lustre: *** cfs_fail_loc=159, val=0*** [ 3716.914426] Lustre: lustre-MDT0001: Client 02c4a7da-508f-44d8-978f-58ef966011bd (at 192.168.201.52@tcp) reconnecting [ 3717.867663] Lustre: *** cfs_fail_loc=159, val=0*** [ 3717.875525] Lustre: Skipped 4 previous similar messages [ 3734.352558] Lustre: lustre-MDT0001: Client 02c4a7da-508f-44d8-978f-58ef966011bd (at 192.168.201.52@tcp) reconnecting [ 3736.329830] Lustre: 139103:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3737.991073] Lustre: *** cfs_fail_loc=159, val=0*** [ 3737.992746] Lustre: Skipped 3 previous similar messages [ 3754.308993] Lustre: lustre-MDT0000: Client 35f0f034-249c-496e-a049-dbe42a8a35bd (at 192.168.201.52@tcp) reconnecting [ 3755.294314] Lustre: *** cfs_fail_loc=159, val=0*** [ 3755.298238] Lustre: Skipped 13 previous similar messages [ 3770.680562] Lustre: lustre-MDT0000: Client 35f0f034-249c-496e-a049-dbe42a8a35bd (at 192.168.201.52@tcp) reconnecting [ 3771.694754] Lustre: 139397:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3790.306834] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3790.307905] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3790.312527] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3790.316426] Lustre: Skipped 1 previous similar message [ 3790.320607] Lustre: Skipped 1 previous similar message [ 3795.429808] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3795.435243] Lustre: Skipped 1 previous similar message [ 3795.776909] Lustre: server umount lustre-OST0000 complete [ 3800.548613] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3800.551940] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3800.561264] Lustre: Skipped 1 previous similar message [ 3800.576701] Lustre: Skipped 1 previous similar message [ 3805.665182] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3805.667954] Lustre: Skipped 1 previous similar message [ 3810.784871] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3810.788183] Lustre: Skipped 1 previous similar message [ 3812.320171] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3812.414814] Lustre: server umount lustre-MDT0000 complete [ 3814.476697] LustreError: 139224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101825 with bad export cookie 2119292035478225023 [ 3814.478251] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3814.485481] LustreError: 139224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3814.702145] Lustre: server umount lustre-MDT0001 complete [ 3819.996563] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 3821.369522] Key type lgssc unregistered [ 3821.527236] LNet: 140481:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3821.531063] LNetError: 140481:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3821.538829] LNet: Removed LNI 192.168.201.152@tcp [ 3821.965597] Key type .llcrypt unregistered [ 3821.967267] Key type ._llcrypt unregistered [ 3834.710240] Key type ._llcrypt registered [ 3834.712130] Key type .llcrypt registered [ 3834.779807] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3835.193640] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3835.241315] alg: No test for adler32 (adler32-zlib) [ 3836.204936] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 3836.314724] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 3837.920182] Key type lgssc registered [ 3838.487276] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3842.256621] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3842.264819] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3843.497452] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3845.695189] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3850.211150] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3850.394783] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3852.350199] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3855.989362] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3858.780142] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3861.975045] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3862.152423] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3864.881590] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3868.318613] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3868.336267] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3875.496757] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3876.618170] Lustre: 144450:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3877.583943] Lustre: 144498:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3878.150521] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3879.702596] Lustre: 144655:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3880.100976] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3880.104786] Lustre: Skipped 1 previous similar message [ 3880.584100] Lustre: 144755:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3884.001086] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3884.004206] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3884.011300] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3886.054677] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3886.054716] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3886.055671] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3886.069392] Lustre: Skipped 1 previous similar message [ 3888.177883] Lustre: server umount lustre-OST0000 complete [ 3891.169597] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3891.172055] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3891.175527] Lustre: Skipped 1 previous similar message [ 3896.292765] LustreError: 141874:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3896.302368] LustreError: 141874:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3896.335984] Lustre: server umount lustre-MDT0000 complete [ 3898.349677] LustreError: 141853:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787101909 with bad export cookie 5843404384776885695 [ 3898.353089] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3898.354834] LustreError: 141853:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3898.494151] Lustre: server umount lustre-MDT0001 complete [ 3904.113248] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 3905.703271] Key type lgssc unregistered [ 3905.890139] LNet: 145813:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3905.896178] LNetError: 145813:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3906.924283] LNet: Removed LNI 192.168.201.152@tcp [ 3907.484922] Key type .llcrypt unregistered [ 3907.487186] Key type ._llcrypt unregistered [ 3919.480205] Key type ._llcrypt registered [ 3919.481590] Key type .llcrypt registered [ 3919.535152] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 3919.961254] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3920.030350] alg: No test for adler32 (adler32-zlib) [ 3920.939590] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 3921.061231] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 3922.680192] Key type lgssc registered [ 3923.227053] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3926.811195] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3926.819741] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3928.089089] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3930.071270] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3933.873778] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3934.095495] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3936.402916] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3940.305913] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3943.430445] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3947.405974] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3947.599298] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3950.916207] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 3952.742635] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3954.563241] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3958.885706] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3961.953549] Lustre: *** cfs_fail_loc=159, val=0*** [ 3978.522898] Lustre: lustre-MDT0000: Client 31362dcb-b862-49a8-b54a-f82097330074 (at 192.168.201.52@tcp) reconnecting [ 3983.844765] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3983.848938] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3983.858639] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3984.864921] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3984.867919] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3984.871433] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3984.882917] Lustre: Skipped 1 previous similar message [ 3986.740441] Lustre: server umount lustre-OST0000 complete [ 3989.995339] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3990.005041] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3990.006708] Lustre: Skipped 1 previous similar message [ 3990.017315] Lustre: Skipped 1 previous similar message [ 3990.765714] Lustre: server umount lustre-MDT0000 complete [ 3992.703618] LustreError: 147186:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787102003 with bad export cookie 14126856926857063717 [ 3992.710135] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3992.712307] LustreError: 147186:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3994.896690] Lustre: server umount lustre-MDT0001 complete [ 4000.320629] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 4001.718272] Key type lgssc unregistered [ 4001.880812] LNet: 150869:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4001.886288] LNetError: 150869:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4001.909868] LNet: Removed LNI 192.168.201.152@tcp [ 4002.330357] Key type .llcrypt unregistered [ 4002.331719] Key type ._llcrypt unregistered [ 4014.532129] Key type ._llcrypt registered [ 4014.537194] Key type .llcrypt registered [ 4014.586763] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 4015.167600] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4015.183993] alg: No test for adler32 (adler32-zlib) [ 4016.074424] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 4016.180112] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 4017.776168] Key type lgssc registered [ 4018.335753] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4022.277590] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4022.290046] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4023.531222] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4025.587093] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4029.843262] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4030.055526] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4031.920503] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4035.145423] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4037.696532] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4041.066242] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4041.272510] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4044.210419] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4048.128742] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4048.427452] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4054.577709] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4068.509416] Lustre: lustre-MDT0001: evicting 980c7960-ab44-4ed6-969f-375463e231eb (at 192.168.201.52@tcp) by administrative request [ 4068.512954] Lustre: Skipped 1 previous similar message [ 4094.433703] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4094.443553] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4094.452145] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4095.459584] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4095.463450] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4095.465107] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4099.302509] Lustre: server umount lustre-OST0000 complete [ 4101.601241] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4101.603857] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4101.608887] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4101.613026] Lustre: Skipped 1 previous similar message [ 4105.698842] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4105.699333] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4107.186139] Lustre: server umount lustre-MDT0000 complete [ 4109.073317] LustreError: 152245:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787102119 with bad export cookie 15034494782179172502 [ 4109.076655] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4109.078312] LustreError: 152245:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4109.254923] Lustre: server umount lustre-MDT0001 complete [ 4114.153335] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 4115.600196] Key type lgssc unregistered [ 4115.778879] LNet: 156336:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4115.783469] LNetError: 156336:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4115.795457] LNet: Removed LNI 192.168.201.152@tcp [ 4116.268272] Key type .llcrypt unregistered [ 4116.273669] Key type ._llcrypt unregistered [ 4152.270054] Key type ._llcrypt registered [ 4152.271322] Key type .llcrypt registered [ 4152.322130] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 4152.714038] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4152.767495] alg: No test for adler32 (adler32-zlib) [ 4153.644098] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 4153.746956] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 4155.344156] Key type lgssc registered [ 4155.832495] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4159.052614] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4159.061261] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4160.243232] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4161.988766] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4166.041474] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4166.242192] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4168.088682] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4170.969207] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4173.288141] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4176.156453] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4176.289312] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4178.513770] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4181.422281] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4185.511076] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4190.637105] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4195.811792] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4195.812608] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4195.814426] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4195.815810] LustreError: Skipped 1 previous similar message [ 4195.820503] Lustre: Skipped 1 previous similar message [ 4196.563772] Lustre: server umount lustre-OST0000 complete [ 4200.092384] Lustre: server umount lustre-MDT0000 complete [ 4200.929468] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4200.930938] LustreError: 158793:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4200.934028] Lustre: Skipped 1 previous similar message [ 4200.943076] LustreError: 158793:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4201.561422] LustreError: 160644:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787102212 with bad export cookie 2909419757894173341 [ 4201.564908] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4201.567879] LustreError: 160644:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4201.702279] Lustre: server umount lustre-MDT0001 complete [ 4205.907680] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 4207.114515] Key type lgssc unregistered [ 4207.306393] LNet: 162355:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4207.309623] LNetError: 162355:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4207.322354] LNet: Removed LNI 192.168.201.152@tcp [ 4207.694796] Key type .llcrypt unregistered [ 4207.696721] Key type ._llcrypt unregistered [ 4219.393245] Key type ._llcrypt registered [ 4219.394856] Key type .llcrypt registered [ 4219.445180] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 4219.795033] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4219.841304] alg: No test for adler32 (adler32-zlib) [ 4220.746621] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 4220.851402] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 4222.440183] Key type lgssc registered [ 4222.890791] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4229.280287] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 21:17:18 (1787102238) [ 4236.451406] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 4240.560221] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 4254.987857] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4254.995790] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4256.086255] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4256.101487] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4256.140122] Lustre: lustre-MDT0000: new disk, initializing [ 4256.177273] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4256.185483] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4257.836416] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4262.696591] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4262.756070] Lustre: 166588:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4262.799046] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4262.801452] Lustre: Skipped 1 previous similar message [ 4262.839527] Lustre: lustre-MDT0001: new disk, initializing [ 4262.890391] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4262.906383] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4262.911225] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4264.642139] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4269.444299] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4272.073402] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4275.202286] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4275.345135] Lustre: lustre-OST0000: new disk, initializing [ 4275.347059] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4275.350358] Lustre: 168554:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4275.403071] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4276.878549] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4276.884208] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4276.927691] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4278.029158] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4282.949849] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4292.580357] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4292.580751] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4292.583124] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4292.585838] Lustre: Skipped 1 previous similar message [ 4292.589667] LustreError: Skipped 1 previous similar message [ 4294.048863] Lustre: server umount lustre-OST0000 complete [ 4297.702487] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4297.704576] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4297.709023] Lustre: Skipped 1 previous similar message [ 4297.714929] Lustre: Skipped 2 previous similar messages [ 4301.954165] Lustre: server umount lustre-MDT0000 complete [ 4303.605214] LustreError: 167381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787102314 with bad export cookie 238361411887669542 [ 4303.608445] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4303.610175] LustreError: 167381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4303.739784] Lustre: server umount lustre-MDT0001 complete [ 4308.740662] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 4309.959279] Key type lgssc unregistered [ 4310.102378] LNet: 170461:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4310.105693] LNetError: 170461:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4310.112476] LNet: Removed LNI 192.168.201.152@tcp [ 4310.471706] Key type .llcrypt unregistered [ 4310.473259] Key type ._llcrypt unregistered [ 4321.321839] Key type ._llcrypt registered [ 4321.323927] Key type .llcrypt registered [ 4321.377146] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 4321.881510] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4321.898112] alg: No test for adler32 (adler32-zlib) [ 4322.790867] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 4322.898287] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 4324.496137] Key type lgssc registered [ 4324.946916] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4328.352707] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4328.365629] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4329.555947] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4331.278001] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4335.380378] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4335.576704] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4337.420797] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4340.662170] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4343.408560] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4346.461792] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4346.677316] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4349.081039] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4352.117424] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4354.857507] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4364.610509] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4364.618015] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4364.624340] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4364.628317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.632613] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4364.997365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.356513] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4365.359020] Lustre: Skipped 1 previous similar message [ 4365.365935] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4365.370367] Lustre: Skipped 1 previous similar message [ 4365.372503] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4365.374809] Lustre: Skipped 1 previous similar message [ 4365.376769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.382224] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4365.385259] Lustre: Skipped 1 previous similar message [ 4365.716461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.051089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.402866] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4366.406176] Lustre: Skipped 2 previous similar messages [ 4366.414396] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4366.418955] Lustre: Skipped 2 previous similar messages [ 4366.420743] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4366.423721] Lustre: Skipped 2 previous similar messages [ 4366.426194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.430827] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4366.433187] Lustre: Skipped 2 previous similar messages [ 4366.790817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.179118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.567217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.972543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.383562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.784934] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4368.788017] Lustre: Skipped 5 previous similar messages [ 4368.794326] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4368.799621] Lustre: Skipped 5 previous similar messages [ 4368.801792] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4368.804788] Lustre: Skipped 5 previous similar messages [ 4368.806214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.810358] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4368.813173] Lustre: Skipped 5 previous similar messages [ 4369.143085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.485061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.803778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.142326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.491080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.832751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.205808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.576939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.921230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.292448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.630977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.949958] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4372.952271] Lustre: Skipped 11 previous similar messages [ 4372.958551] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4372.963683] Lustre: Skipped 11 previous similar messages [ 4372.965495] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4372.967935] Lustre: Skipped 11 previous similar messages [ 4372.969765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.975708] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4372.977826] Lustre: Skipped 11 previous similar messages [ 4373.290368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.644248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.988223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.315517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.645677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.988320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.338890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.682531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.021125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.384106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.732966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.071253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.416887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.774742] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4377.779330] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4377.780488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.107046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.436976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.783808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.141303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.503114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.852967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.185063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.502387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.830300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.171539] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4381.173781] Lustre: Skipped 23 previous similar messages [ 4381.180283] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4381.185146] Lustre: Skipped 23 previous similar messages [ 4381.186854] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4381.189376] Lustre: Skipped 23 previous similar messages [ 4381.191171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.195444] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4381.197884] Lustre: Skipped 23 previous similar messages [ 4381.559505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.923613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.315599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.690226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.073208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.443534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.781754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.099457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.454722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.813528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.163066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.540109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.906270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.234394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.585923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.925689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.275746] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4387.280125] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4387.280416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.619527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.947356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.287479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.652967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.014683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.397741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.782682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.162383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.569704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.963752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.313520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.712289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.060939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.423478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.762872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.129195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.476252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.805031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.127376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.478301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.810261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.133619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.453739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.809300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.147011] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.487566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.828175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.160994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.497703] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4397.500047] Lustre: Skipped 45 previous similar messages [ 4397.506892] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4397.511849] Lustre: Skipped 45 previous similar messages [ 4397.513420] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4397.515815] Lustre: Skipped 45 previous similar messages [ 4397.517814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.522686] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4397.525288] Lustre: Skipped 45 previous similar messages [ 4397.868405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.214537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.560239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.924538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.258234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.633126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.983967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.312186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.631287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.964494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.295583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.634685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.993659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.352263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.717546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.112926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.498466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.879197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.275606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.609079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.989078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.357216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.725202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.077188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.410490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.755320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.113890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.452669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.793187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.172244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.547284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.890359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.211692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.543468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.891801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.252375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.592571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.924759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.261275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.612468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.956528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.294389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.617400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.949379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.276097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.613452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.989519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.357773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.748208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.100215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.441444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.795817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.128284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.459170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.795474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.165174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.554082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.919210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.287542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.668924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.023826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.346931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.677107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.008527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.333803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.655515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.989471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4421.318141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4421.663351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.037854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.382971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.738606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.091563] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4423.096441] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4423.096552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.431837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.772367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.105430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.454971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.802994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.158826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.493140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.886666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.250515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.600743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.954960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4427.349426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4427.715882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.082086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.441635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.823691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.179053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.503289] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4429.505847] Lustre: Skipped 90 previous similar messages [ 4429.513366] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4429.519132] Lustre: Skipped 90 previous similar messages [ 4429.521646] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4429.525143] Lustre: Skipped 90 previous similar messages [ 4429.526787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.530655] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4429.533737] Lustre: Skipped 90 previous similar messages [ 4429.870150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.236987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.616363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.959218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4431.299261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4431.649277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.003288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.338048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.692796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.043517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.394697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.747196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.135079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.530594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.893303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.256252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.613737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.942664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.272375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.587747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.938646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.265720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.592082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.923088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.259762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.594254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.921300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.240687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.585738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.934735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.254191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.578655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.908549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.226345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.539855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.865922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.193477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.522567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.854358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.184606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.566553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.934274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4444.302755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4444.662872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.005090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.359377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.715595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.070291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.402612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.750322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.100319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.438578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.774634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.113967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.444056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.784455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.115214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.495671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.875874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.279964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.668680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.035704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.380971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.718781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.078422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.438196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.782081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.151132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.504445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.857297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.227395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.558409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.908960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.266181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.612516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.968947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.307140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.646070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.987710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.347629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.704352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.136902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.518286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.882331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.254891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.644083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.021862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.353238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.674838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.019427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.339754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.670316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.985263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.318481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.640844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.004620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.345767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.678877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.029599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.367784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.692499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.019013] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.362400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.680134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.020672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.355435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.690453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.048130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.371609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.702301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.033446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.398906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.749632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.085136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.445760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.806392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.135729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.463961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.821695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.143403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.466191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.797908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.155477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.499165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.844251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.234192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.601958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.914164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4474.239862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4474.623065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4474.962940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4475.308554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4475.684265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4476.035124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4476.406921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4476.794619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4477.150069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4477.515354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4477.894977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4478.270276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4478.593935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4478.955051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.348381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.676888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.025308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.445292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.845818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.235222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.576598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.899439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4482.222972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4482.567440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4482.890722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4483.215762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4483.552232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4483.903899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.231218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.585823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.926990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4485.282193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4485.607035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4485.941587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4486.290369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4486.638722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4486.960445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.292432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.624817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.968087] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4487.972242] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4487.973137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4488.303297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4488.632538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.003505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.364474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.716374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4490.054357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4490.370076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4490.698678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.030361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.376356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.713152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4492.041805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4492.366673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4492.705690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.036880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.389962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.734130] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4493.737443] Lustre: Skipped 184 previous similar messages [ 4493.743944] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4493.747797] Lustre: Skipped 184 previous similar messages [ 4493.749565] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4493.751901] Lustre: Skipped 184 previous similar messages [ 4493.753559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.758347] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4493.760630] Lustre: Skipped 184 previous similar messages [ 4494.109940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4494.462191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4494.831314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4495.169470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4495.511084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4495.865092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4496.211742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4496.559514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4496.913302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.268941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.617293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.970882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4498.335328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4498.725734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.082181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.429033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.790916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4500.119689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4500.469641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4500.809523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.168296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.504279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.855183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4502.285847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4502.681470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.058108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.407601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.773698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4504.126652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4504.488572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4504.833970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4505.217060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4505.561964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4505.921425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4506.259210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4506.620832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4506.957268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4507.339844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4507.708847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4508.086860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4508.447509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4508.806407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4509.176044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4509.495763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4509.809372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.125066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.493381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.828264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4511.151158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4511.472296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4511.804591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4512.123809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4512.449844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4512.771435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.085484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.403677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.736711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4514.052051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4514.374229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4514.696244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4515.076223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4515.398022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4515.721161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4516.036902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4516.382492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4516.731274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.110769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.481745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.837832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.198662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.545834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.882331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4519.260408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4519.604912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4519.936501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4520.276515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4520.612469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4520.970936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4521.299661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4521.620452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4521.943670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.271327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.619432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.953761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4523.253223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4523.573905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4523.876903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4524.193705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4524.512596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4524.847349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4525.185089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4525.491479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4525.811859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4526.134154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4526.466254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4526.824875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.145601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.490728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.805893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4528.127915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4528.465522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4528.814957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4529.133299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4529.508260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4529.846761] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4529.850271] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4529.853643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4530.200749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4530.512501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4530.846895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.192662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.517977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.849178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.177397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.528565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.888790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4533.246678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4533.593020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4533.907688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4534.213664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4534.516602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4534.834954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4535.145172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4535.465992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4535.831775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4536.187463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4536.534145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4536.877043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4537.210691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4537.563702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4537.900078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.283993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.634661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.967773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4539.319503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4539.625477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4539.954059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.293758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.616970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.943170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4541.295360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4541.620566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4541.969033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4542.302989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4542.677029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4542.997342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4543.333036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4543.656575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4543.993808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4544.303685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4544.620784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4544.937055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4545.298246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4545.637754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4545.990124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4546.350605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4546.677710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4547.037558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4547.393957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4547.695715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4548.011181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4548.338913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4548.666730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4549.022127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4549.376855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4549.723184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4550.047759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4550.386551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4550.699432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.023873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.349319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.653709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.985085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4552.308659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4552.662924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4552.970252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4553.299082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4553.617742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4553.970557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4554.291704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4554.632353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4554.969421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4555.339109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4555.753219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.198724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.612561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.981567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4557.358366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4557.735848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4558.087110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4558.411753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4558.735541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4559.091091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4559.459529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4559.814253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4560.159581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4560.498472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4560.829073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.150949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.510628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.853165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4562.192303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4562.598392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4563.124470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4563.498599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4563.934821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4564.339579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4564.785935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4565.280444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4565.776580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4566.283153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4566.863183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4567.407650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4567.968821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4568.554329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4569.253603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4569.864241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4570.535275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4571.244564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4572.015508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4572.536862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4573.202050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4574.424966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4575.668874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4576.346757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4577.010361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4577.653894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4578.736288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4579.344743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4579.907410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4580.406266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4580.997966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4581.634979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4582.323916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4583.060370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4583.781029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4584.491060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4585.056587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4585.662457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4586.228405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4586.800531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4587.407244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4588.087251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4588.731922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4589.397150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4590.156443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4590.866828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4591.627876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4592.403731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4593.027877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4593.705957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4594.404178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4595.246694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4596.057557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4596.814426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4597.549327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4598.188702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4599.223976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4600.063110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4600.896322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4601.553354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4602.148690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4602.737760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4603.357571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4603.942166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4604.534070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4605.084867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4605.657597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4606.216881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4606.780061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4607.291731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4607.731131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4608.247043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4608.750809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4609.212019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4609.686275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4610.144489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4610.681650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4611.225306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4611.666261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.158581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.727373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4613.191139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4613.622878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4614.050819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4614.426806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4614.785755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4615.190173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4615.585855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4615.967485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4616.333108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4616.737370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4617.182168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4617.630849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.022042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.401199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.771289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4619.132538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4619.542172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4619.959806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4620.399726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4620.812523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4621.285051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4621.696397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4622.183274] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4622.187393] Lustre: Skipped 302 previous similar messages [ 4622.195265] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4622.201737] Lustre: Skipped 302 previous similar messages [ 4622.204854] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4622.208243] Lustre: Skipped 302 previous similar messages [ 4622.221638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4622.229141] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4622.231800] Lustre: Skipped 302 previous similar messages [ 4622.693596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.084969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.493331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.882652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4624.276301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4624.713984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4625.185090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4625.633343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4625.999624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4626.408655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4626.765035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4627.119444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4627.485804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4627.904787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4628.273704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4628.666082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4629.077739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4629.600778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4630.096230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4630.581160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4630.998215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.423572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.833549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4632.219880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4632.628963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4632.993501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4633.434298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4633.891119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4634.231203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4634.585439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4634.942561] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4634.946676] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4634.947882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4635.297384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4635.667541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4636.032952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4636.382525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4636.731049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4637.082463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4637.426722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4637.803447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4638.196473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4638.597822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.009437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.451748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.839093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4640.213421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4640.603855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.029079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.420757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.848430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4642.235303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4642.670027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4643.118901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4643.571795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4644.031453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4644.462910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4644.847109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4645.206037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4645.585481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.020207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.417068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.812926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4647.220476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4647.708957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.117773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.510926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.911305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4649.310408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4649.717177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.105612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.496690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.837076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4651.194156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4651.608645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.007268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.379352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.744050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.130025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.547835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.960544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4654.334115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4654.757934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.168836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.617135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.047349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.421579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.796381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4657.161270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4657.522557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4657.878054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.230365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.562206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.924279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.280190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.653432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.084301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.478504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.841310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4661.218681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4661.572768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4661.927921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.281368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.644943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.995042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4663.359129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4663.725394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4664.065158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4664.432323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4664.826341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4665.214655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4665.616655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.003861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.359196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.718121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.091403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.456149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.846053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.195873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.591554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.960742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.326681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.673550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4670.038075] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4670.044056] LustreError: 171880:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4670.046944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4670.392100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4670.736449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4671.121708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4671.490443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4671.841217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.168715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.514408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.865808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4673.240979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4673.625691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.000766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.421507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.822688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.211443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.605690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.994714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4676.355318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4676.722516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.117242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.467280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.852735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.245427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.607445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.982893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.390532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.762164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.149960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.504428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.831342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.167969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.533118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.890597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.274233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.650182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.016677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.439736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.802946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.166651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.492763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.819449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.150674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.466590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.788462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.112329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.510783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.924031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4687.317126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4687.678890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.066690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.468361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.863397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.291166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.708561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.074210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.480634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.943414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4691.367251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4691.777799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.226336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.666149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.064778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.464574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.964344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.308257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.665789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.077950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.495755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.886890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.293385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.710166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.094212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.553940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.043915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.527084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.956500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.421603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.820678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4700.247768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4700.671308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.062260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.404337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.781032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.159366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.548185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.923151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.346161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.717229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4704.093713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4704.492055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4704.898769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.287844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.633870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.011240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.391332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.754772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4707.166984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4707.575307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.022917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.482818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.974684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4709.369358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4709.781100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.231663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.650633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.057334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.486208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.900687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4712.299871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4712.704481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4713.177703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4713.577284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.002386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.457968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.886785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4715.357628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4715.864249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.332344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.774944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4717.203517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4717.651728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.081118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.497488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.933569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4719.394644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4719.857308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4720.339578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4720.794320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.254824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.694873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.131185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.548200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4723.002399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4723.511079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4723.947331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4724.336146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4724.712077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.059100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.426959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.838480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.214377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.570525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.967205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.342445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.700378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.113364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.479081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.922033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.396662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.818341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.187117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.547828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.909416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.271341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.629407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.998241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4732.372829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4732.702983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.059298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.430413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.784295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.164522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.495836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.852678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.216977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.598539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.938153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.321237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.686392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.032864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.407495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.744475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.086153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.455076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.809292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.168943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.561454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.967872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.353202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.734641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.119872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.536749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.966995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4742.395721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4742.779292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.201619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.591055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.970688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4744.426595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4744.867705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.289293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.684901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.085259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.482612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.859221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.226916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.672420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.053256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.420979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.791320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.166944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.531667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.909818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.363503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.789487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4751.231793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.788468] LustreError: 174348:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4861.792152] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 4861.795729] LustreError: 171880:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 3 previous similar messages [ 4947.424910] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4947.427229] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4947.431148] Lustre: Skipped 327 previous similar messages [ 4947.433508] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4948.963336] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4948.966195] Lustre: Skipped 1 previous similar message [ 4949.298310] Lustre: server umount lustre-OST0000 complete [ 4954.082777] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4954.085339] Lustre: Skipped 1 previous similar message [ 4956.928637] Lustre: server umount lustre-MDT0000 complete [ 4958.232955] LustreError: 173701:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787102968 with bad export cookie 8919055497681392264 [ 4958.235297] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4958.236686] LustreError: 173701:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4958.343631] Lustre: server umount lustre-MDT0001 complete [ 4961.992838] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 4963.064619] Key type lgssc unregistered [ 4963.205353] LNet: 226912:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4963.207772] LNetError: 226912:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4963.214291] LNet: Removed LNI 192.168.201.152@tcp [ 4963.515984] Key type .llcrypt unregistered [ 4963.517041] Key type ._llcrypt unregistered [ 4972.541017] Key type ._llcrypt registered [ 4972.542101] Key type .llcrypt registered [ 4972.580182] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 4972.921542] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4972.950095] alg: No test for adler32 (adler32-zlib) [ 4973.823501] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 4973.921755] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 4975.504104] Key type lgssc registered [ 4975.868695] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4978.421934] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4978.429644] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4979.571335] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4980.876616] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4983.652053] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4983.793987] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4985.221665] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4987.613619] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4989.445793] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4991.707159] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4991.819507] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4993.730276] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 4996.099657] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5005.160310] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 5008.584854] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5009.188902] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5009.193719] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5009.197465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.201139] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5009.201143] LustreError: 228322:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 5010.402902] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5010.407647] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5010.409785] Lustre: Skipped 1 previous similar message [ 5011.744193] Lustre: lustre-OST0000: Not available for connect from 192.168.201.52@tcp (stopping) [ 5011.924101] Lustre: server umount lustre-OST0000 complete [ 5029.280148] LustreError: 228322:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 5040.224545] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5040.365943] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5042.320542] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5044.991558] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5050.594887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.599643] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5050.601221] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.757376] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 7 sec [ 5054.610941] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff94fe075c5000.ost_server_uuid 50 [ 5055.150533] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff94fe075c5000.ost_server_uuid in FULL state after 0 sec [ 5061.092950] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5061.093492] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5061.094757] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5061.097564] Lustre: Skipped 2 previous similar messages [ 5062.350157] Lustre: server umount lustre-OST0000 complete [ 5065.696768] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5065.699886] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5065.704344] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5065.706141] Lustre: Skipped 1 previous similar message [ 5069.720051] Lustre: server umount lustre-MDT0000 complete [ 5070.901418] LustreError: 228285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103081 with bad export cookie 15308168761848127429 [ 5070.904216] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5070.904929] LustreError: 228285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5071.034659] Lustre: server umount lustre-MDT0001 complete [ 5074.726631] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 5075.784488] Key type lgssc unregistered [ 5075.929347] LNet: 233532:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5075.931991] LNetError: 233532:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5075.938299] LNet: Removed LNI 192.168.201.152@tcp [ 5076.265584] Key type .llcrypt unregistered [ 5076.267476] Key type ._llcrypt unregistered [ 5087.417583] Key type ._llcrypt registered [ 5087.418636] Key type .llcrypt registered [ 5087.452517] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5087.821304] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5087.857183] alg: No test for adler32 (adler32-zlib) [ 5088.713085] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 5088.798639] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 5090.376169] Key type lgssc registered [ 5090.751938] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5093.868665] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5093.873977] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5095.011152] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5096.316846] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5099.016659] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5099.142875] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5100.457145] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5101.405500] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5103.596527] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5103.714015] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5104.743543] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 5105.578737] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5108.304871] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5108.367164] Lustre: lustre-OST0001: new disk, initializing [ 5108.368984] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5108.371564] Lustre: 237548:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5108.402563] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5110.216863] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5110.221379] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5110.253506] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5110.300691] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5116.799275] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5121.482360] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5130.209717] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5130.213546] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5130.220335] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5130.722335] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5130.726265] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5130.726546] Lustre: Skipped 2 previous similar messages [ 5130.728747] Lustre: Skipped 1 previous similar message [ 5133.921166] Lustre: server umount lustre-MDT0000 complete [ 5135.204699] LustreError: 235261:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103145 with bad export cookie 18390498450031557600 [ 5135.207284] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5135.209431] LustreError: 235261:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5135.326794] Lustre: server umount lustre-MDT0001 complete [ 5146.885931] Lustre: server umount lustre-OST0000 complete [ 5157.472994] Lustre: server umount lustre-OST0001 complete [ 5164.117994] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5167.506171] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5167.642184] LustreError: 240649:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5167.650406] LustreError: 240649:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5167.660912] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5168.995782] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5171.797740] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5173.238976] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5174.240882] Lustre: 241790:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5176.622053] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5176.752979] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5176.755315] Lustre: Skipped 1 previous similar message [ 5177.764463] LustreError: 242143:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5177.768871] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 5178.623100] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5181.420048] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5182.504817] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 5182.510483] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 5183.418676] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5186.513983] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5187.601121] Lustre: 243658:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5192.679173] Lustre: mylustre-MDT0000-lwp-OST0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5192.683121] Lustre: Skipped 3 previous similar messages [ 5192.683753] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5192.686344] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5192.687237] Lustre: Skipped 4 previous similar messages [ 5196.964158] Lustre: server umount mylustre-MDT0000 complete [ 5197.794982] LustreError: 242165:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5197.799879] LustreError: 242165:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5198.253534] LustreError: 240627:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103208 with bad export cookie 18390498450031560421 [ 5198.257615] LustreError: 240627:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5198.257653] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5198.374959] Lustre: server umount mylustre-MDT0001 complete [ 5210.116173] Lustre: server umount mylustre-OST0000 complete [ 5220.580867] Lustre: server umount mylustre-OST0001 complete [ 5227.038669] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5230.307927] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5230.444433] LustreError: 245963:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5230.462150] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5230.465322] Lustre: Skipped 1 previous similar message [ 5231.809984] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5234.653853] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5236.118477] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5237.079187] Lustre: 247105:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5239.426996] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5240.610993] LustreError: 247457:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5240.615770] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 5241.557113] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5244.472828] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5245.611652] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:161) [ 5245.618418] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:65) [ 5246.560864] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5249.685071] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5250.816187] Lustre: 248974:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5255.137138] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5255.140028] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5255.144139] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 5258.911207] Lustre: server umount tfs-MDT0000 complete [ 5260.194504] LustreError: 246708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103270 with bad export cookie 18390498450031562598 [ 5260.198665] LustreError: 246708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5260.200195] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5260.319136] Lustre: server umount tfs-MDT0001 complete [ 5271.872804] Lustre: server umount tfs-OST0000 complete [ 5283.360698] Lustre: server umount tfs-OST0001 complete [ 5289.671149] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5292.730330] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5292.858697] LustreError: 251230:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5292.876314] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5292.878234] Lustre: Skipped 3 previous similar messages [ 5294.180698] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5296.832471] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5298.247273] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5299.185856] Lustre: 252370:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5301.330189] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5302.502093] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 5303.319043] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5306.089866] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5307.178794] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:193) [ 5307.179717] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:97) [ 5307.897912] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5311.001318] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5312.174608] Lustre: 254237:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5314.307720] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 21:35:24 (1787103324) [ 5327.844788] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5327.846791] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5327.847839] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5327.847849] Lustre: Skipped 4 previous similar messages [ 5327.850127] Lustre: Skipped 6 previous similar messages [ 5332.320841] Lustre: server umount lustre-MDT0000 complete [ 5332.963654] LustreError: 254500:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5332.968744] LustreError: 254500:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 5333.597608] LustreError: 251206:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103344 with bad export cookie 18390498450031564509 [ 5333.601833] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5333.603150] LustreError: 251206:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 5338.081821] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5338.082681] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5338.087756] Lustre: Skipped 1 previous similar message [ 5338.089291] Lustre: Skipped 3 previous similar messages [ 5339.793299] Lustre: server umount lustre-MDT0001 complete [ 5347.194756] Lustre: server umount lustre-OST0000 complete [ 5354.446991] Lustre: server umount lustre-OST0001 complete [ 5356.340498] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 5359.118104] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5370.435320] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 5370.435320] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5370.435320] [ 5370.442074] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5370.513754] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5370.522258] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5370.554633] Lustre: lustre-MDT0000: new disk, initializing [ 5370.574313] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5370.576407] Lustre: Skipped 3 previous similar messages [ 5370.581975] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5371.846583] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5375.840036] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 5375.840036] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5375.840036] [ 5375.871704] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5375.912468] Lustre: 257417:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5375.936779] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5375.938692] Lustre: Skipped 1 previous similar message [ 5375.975048] Lustre: lustre-MDT0001: new disk, initializing [ 5376.019853] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5376.023790] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5377.402614] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5381.472179] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5381.569429] Lustre: lustre-OST0000: new disk, initializing [ 5381.571145] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5381.573694] Lustre: 258997:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5383.288652] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5383.291968] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5383.329849] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5383.531260] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5387.680761] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5387.746429] Lustre: lustre-OST0001: new disk, initializing [ 5387.748261] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5387.750777] Lustre: 259868:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5388.801990] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5388.804667] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5388.840380] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5389.756917] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5393.811087] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 21:36:43 (1787103403) [ 5397.123221] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 21:36:46 (1787103406) [ 5409.254626] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5409.257061] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5409.258812] Lustre: Skipped 1 previous similar message [ 5409.259435] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5409.259442] Lustre: Skipped 1 previous similar message [ 5414.525657] Lustre: server umount lustre-OST0000 complete [ 5419.490146] LustreError: 259301:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5419.494981] LustreError: 259301:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5430.240099] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5430.305893] Lustre: server umount lustre-MDT0000 complete [ 5431.577317] LustreError: 259867:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103442 with bad export cookie 18390498450031566287 [ 5431.580835] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5431.581914] LustreError: 259867:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5437.756227] Lustre: server umount lustre-MDT0001 complete [ 5441.262979] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 5510.360199] Lustre: server umount lustre-OST0001 complete [ 5512.545074] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 5519.335069] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5531.083127] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5531.158750] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5531.168553] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5531.201918] Lustre: lustre-MDT0000: new disk, initializing [ 5531.222129] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5531.224899] Lustre: Skipped 3 previous similar messages [ 5531.229511] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5532.489333] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5536.652764] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5536.698636] Lustre: 264640:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5536.790827] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5538.077961] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5541.732545] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5543.552457] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5545.774355] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5545.873866] Lustre: 266609:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5547.818593] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5547.905101] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5547.908074] Lustre: Skipped 1 previous similar message [ 5547.910136] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5547.956482] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5551.592437] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5558.241989] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5558.243428] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5558.244201] LustreError: Skipped 3 previous similar messages [ 5558.247154] Lustre: Skipped 4 previous similar messages [ 5558.247720] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5558.250851] Lustre: Skipped 16 previous similar messages [ 5560.022114] Lustre: server umount lustre-OST0000 complete [ 5567.382920] Lustre: server umount lustre-MDT0000 complete [ 5568.480866] LustreError: 266271:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5568.487665] LustreError: 266271:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 5568.526074] LustreError: 264633:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103579 with bad export cookie 18390498450031567757 [ 5568.528734] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5568.529076] LustreError: 264633:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5568.637607] Lustre: server umount lustre-MDT0001 complete [ 5572.142101] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 5573.118420] Key type lgssc unregistered [ 5573.233339] LNet: 268370:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5573.235589] LNetError: 268370:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5573.242237] LNet: Removed LNI 192.168.201.152@tcp [ 5573.531110] Key type .llcrypt unregistered [ 5573.532472] Key type ._llcrypt unregistered [ 5583.842990] Key type ._llcrypt registered [ 5583.843957] Key type .llcrypt registered [ 5583.887426] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5584.357743] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5584.368572] alg: No test for adler32 (adler32-zlib) [ 5585.212387] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 5585.298369] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 5586.880198] Key type lgssc registered [ 5587.208875] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5589.611860] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5589.617486] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5590.747417] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5592.004354] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5594.592648] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5594.698079] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5595.867591] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5598.057141] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5599.774343] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5602.027302] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5602.149606] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5603.978973] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5606.224359] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5606.536752] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 5610.466487] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5610.467038] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5610.472275] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5613.263164] Lustre: server umount lustre-OST0000 complete [ 5615.072917] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5615.076050] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5615.081678] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5620.632504] Lustre: server umount lustre-MDT0000 complete [ 5620.705922] LustreError: 272109:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5620.712164] LustreError: 272109:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5621.856100] LustreError: 272336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103632 with bad export cookie 16379424282259492181 [ 5621.859507] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5621.859607] LustreError: 272336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 5621.974243] Lustre: server umount lustre-MDT0001 complete [ 5625.787464] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 5626.928969] Key type lgssc unregistered [ 5627.070668] LNet: 273392:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5627.074072] LNetError: 273392:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5627.081499] LNet: Removed LNI 192.168.201.152@tcp [ 5627.372811] Key type .llcrypt unregistered [ 5627.374219] Key type ._llcrypt unregistered [ 5634.279547] Key type ._llcrypt registered [ 5634.281043] Key type .llcrypt registered [ 5634.319792] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5634.643432] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5634.670081] alg: No test for adler32 (adler32-zlib) [ 5635.519026] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 5635.601314] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 5637.176194] Key type lgssc registered [ 5637.494884] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5640.363715] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5640.369387] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5655.776418] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 5660.896297] LustreError: 274562:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.152@tcp: failed processing log, type 4: rc = -110 [ 5687.520220] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5689.357730] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5691.663596] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5692.371329] Lustre: server umount lustre-OST0000 complete [ 5697.667500] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 5698.630338] Key type lgssc unregistered [ 5698.760379] LNet: 276194:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5698.762944] LNetError: 276194:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5698.771305] LNet: Removed LNI 192.168.201.152@tcp [ 5699.056141] Key type .llcrypt unregistered [ 5699.057684] Key type ._llcrypt unregistered [ 5712.772973] Key type ._llcrypt registered [ 5712.774326] Key type .llcrypt registered [ 5712.814250] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5713.288845] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5713.295824] alg: No test for adler32 (adler32-zlib) [ 5714.154280] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 5714.238090] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 5715.816168] Key type lgssc registered [ 5716.187558] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5720.576933] loop0: detected capacity change from 0 to 204800000 [ 5720.629176] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5720.633388] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5720.747363] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5721.112120] loop0: detected capacity change from 0 to 204800000 [ 5721.172079] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5721.177245] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5721.305342] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5721.649180] loop0: detected capacity change from 0 to 204800000 [ 5721.706685] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5721.710574] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5721.753173] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5722.120494] loop0: detected capacity change from 0 to 204800000 [ 5722.177850] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5722.555034] loop0: detected capacity change from 0 to 204800000 [ 5722.562183] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5723.836433] loop0: detected capacity change from 0 to 204800000 [ 5723.845209] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5725.133505] loop0: detected capacity change from 0 to 204800000 [ 5725.144173] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5726.409259] loop0: detected capacity change from 0 to 204800000 [ 5726.418338] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5727.681472] loop0: detected capacity change from 0 to 204800000 [ 5727.706479] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5727.716460] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5727.751225] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5727.754759] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 5727.758314] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 5727.761780] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 5727.765879] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 5727.769534] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 5727.772855] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 5727.776347] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 5727.779632] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 5727.783225] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 5727.787207] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 5727.790529] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 5727.794306] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 5727.797597] Lustre: 279583:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 5730.317859] Lustre: server umount MGS complete [ 5730.609225] loop0: detected capacity change from 0 to 204800000 [ 5730.634316] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5730.775295] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5730.789533] Lustre: lustre-MDT0000: Aborting client recovery [ 5731.093165] loop1: detected capacity change from 0 to 204800000 [ 5731.121714] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5731.157267] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5731.162097] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 5731.165777] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 5731.169759] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 5731.174369] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 5731.178568] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 5731.182088] Lustre: 280016:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 5731.189550] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5731.562048] loop2: detected capacity change from 0 to 204800000 [ 5731.587360] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5731.618194] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5731.623189] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 5731.629454] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 5731.634758] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 5731.640499] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 5731.644800] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 5731.648680] Lustre: 280098:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 5731.691499] Lustre: Found index 0 for lustre-OST0000, updating log [ 5731.701210] Lustre: 280116:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5731.717117] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5731.720154] Lustre: Skipped 1 previous similar message [ 5731.725211] Lustre: lustre-OST0000: Aborting recovery [ 5732.018923] loop3: detected capacity change from 0 to 204800000 [ 5732.055627] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5732.087708] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5732.092988] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 5732.096989] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 5732.101475] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 5732.105360] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 5732.108907] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 5732.112498] Lustre: 280181:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 5737.446194] LustreError: 279960:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 5740.514397] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 5740.514500] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 5740.514621] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 5740.519433] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 5740.521091] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 5740.529390] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 5742.857924] LustreError: 279925:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 309us: rc = -2 [ 5755.872776] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5755.873240] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5755.877048] Lustre: Skipped 2 previous similar messages [ 5755.879849] Lustre: Skipped 1 previous similar message [ 5760.159660] Lustre: server umount lustre-MDT0000 complete [ 5760.460509] LustreError: 279910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103771 with bad export cookie 8709352630925810055 [ 5760.462304] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5760.465317] LustreError: 279910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5760.992493] LustreError: 279924:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5760.992595] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5760.992716] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5760.992721] Lustre: Skipped 2 previous similar messages [ 5760.998720] LustreError: 279924:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5761.003528] Lustre: Skipped 2 previous similar messages [ 5766.112983] LustreError: 279954:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5766.113050] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5766.117214] LustreError: 279954:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5766.118798] Lustre: Skipped 2 previous similar messages [ 5766.708799] Lustre: server umount lustre-MDT0001 complete [ 5773.121645] Lustre: server umount lustre-OST0000 complete [ 5779.549349] Lustre: server umount lustre-OST0001 complete [ 5782.234611] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 21:43:12 (1787103792) [ 5791.184266] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 5794.254487] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 5805.931126] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5806.007490] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5806.016962] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5806.047463] Lustre: lustre-MDT0000: new disk, initializing [ 5806.066362] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5806.068428] Lustre: Skipped 1 previous similar message [ 5806.073464] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5807.350449] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5811.341342] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5811.387367] Lustre: 284243:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5811.412605] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5811.414867] Lustre: Skipped 1 previous similar message [ 5811.450322] Lustre: lustre-MDT0001: new disk, initializing [ 5811.481501] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5811.493922] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5811.498035] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5812.758740] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5816.331573] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5818.239273] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5820.721125] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5820.824939] Lustre: lustre-OST0000: new disk, initializing [ 5820.827627] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5820.831750] Lustre: 286209:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5820.834508] Lustre: 286209:0:(osd_compat.c:1352:osd_object_spec_find()) Skipped 1 previous similar message [ 5820.866696] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5823.524812] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5827.096254] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5827.116545] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5827.184148] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5829.395973] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5833.714024] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 5842.290566] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 5848.027382] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 5893.604978] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5893.607298] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5893.624096] LustreError: Skipped 1 previous similar message [ 5893.626399] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5893.628931] Lustre: Skipped 1 previous similar message [ 5898.724149] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5898.726470] Lustre: Skipped 1 previous similar message [ 5903.328772] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5903.447358] Lustre: server umount lustre-OST0000 complete [ 5908.961431] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5908.963252] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5908.969935] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5908.980919] Lustre: Skipped 2 previous similar messages [ 5911.493606] Lustre: server umount lustre-MDT0000 complete [ 5913.268465] LustreError: 284235:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787103923 with bad export cookie 8709352630925812764 [ 5913.271139] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5913.276641] LustreError: 284235:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5913.430980] Lustre: server umount lustre-MDT0001 complete [ 5917.489917] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5919.669991] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5922.341205] Lustre: server umount MGS complete [ 5928.792321] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5929.048167] LustreError: 290118:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5929.058919] LustreError: 290131:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5929.103812] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5931.467293] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5934.562243] LustreError: 290119:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5936.487591] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5939.292391] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5944.029393] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5947.306916] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5951.415531] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5951.630669] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5951.633763] Lustre: Skipped 1 previous similar message [ 5955.341662] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 5959.784581] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5987.810318] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5987.811791] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5987.813756] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5987.817416] Lustre: Skipped 1 previous similar message [ 5987.819818] Lustre: Skipped 1 previous similar message [ 5992.547534] Lustre: server umount lustre-OST0000 complete [ 5998.051969] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5998.056720] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5998.070938] Lustre: Skipped 1 previous similar message [ 6000.872933] Lustre: server umount lustre-MDT0000 complete [ 6003.129779] LustreError: 291960:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787104013 with bad export cookie 8709352630925814591 [ 6003.130973] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6003.136326] LustreError: 291960:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6003.325915] Lustre: server umount lustre-MDT0001 complete [ 6009.385244] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 6010.833142] Key type lgssc unregistered [ 6011.021812] LNet: 294062:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6011.026361] LNetError: 294062:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6011.037622] LNet: Removed LNI 192.168.201.152@tcp [ 6011.513428] Key type .llcrypt unregistered [ 6011.515112] Key type ._llcrypt unregistered [ 6032.111891] Key type ._llcrypt registered [ 6032.115466] Key type .llcrypt registered [ 6032.192573] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 6040.677465] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 6041.148695] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6041.204437] alg: No test for adler32 (adler32-zlib) [ 6042.093363] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 6042.244393] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 6043.840189] Key type lgssc registered [ 6044.315523] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6060.310105] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6060.322262] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6061.454825] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6061.470538] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6061.512959] Lustre: lustre-MDT0000: new disk, initializing [ 6061.569848] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6061.578478] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6063.559441] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6068.972394] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6069.019602] Lustre: 297996:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6069.044240] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6069.046313] Lustre: Skipped 1 previous similar message [ 6069.084672] Lustre: lustre-MDT0001: new disk, initializing [ 6069.138961] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6069.156069] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6069.160489] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6070.879767] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6076.303765] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6079.880934] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6083.859679] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6084.047688] Lustre: lustre-OST0000: new disk, initializing [ 6084.050422] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6084.055540] Lustre: 299962:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6084.113274] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6087.524367] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6091.290862] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6091.296108] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6091.348796] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6092.471364] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6096.505562] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6102.461217] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6109.518499] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6114.352339] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 6147.555934] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6147.556751] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6147.560076] LustreError: Skipped 1 previous similar message [ 6147.561427] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6147.568742] Lustre: Skipped 1 previous similar message [ 6147.576705] Lustre: Skipped 1 previous similar message [ 6152.675172] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6152.679239] Lustre: Skipped 1 previous similar message [ 6157.797298] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6157.800396] Lustre: Skipped 1 previous similar message [ 6160.352811] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6160.424632] Lustre: server umount lustre-OST0000 complete [ 6162.913779] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6162.916841] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6162.919374] Lustre: Skipped 1 previous similar message [ 6162.933315] Lustre: Skipped 1 previous similar message [ 6168.036245] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6168.044667] Lustre: Skipped 1 previous similar message [ 6168.726619] LustreError: 302092:0:(ldlm_resource.c:1207:ldlm_resource_complain()) MGS: namespace resource [0x736d61726170:0x3:0x0].0x0 (00000000ec6208b0) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 6170.813862] Lustre: server umount lustre-MDT0000 complete [ 6172.846281] LustreError: 301163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787104183 with bad export cookie 9789281438883242163 [ 6172.849179] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6172.853392] LustreError: 301163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6173.089465] Lustre: server umount lustre-MDT0001 complete [ 6177.726516] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6180.046280] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6182.640191] Lustre: server umount MGS complete [ 6187.645567] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6187.909989] LustreError: 303885:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6187.953331] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6189.792710] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6193.123308] LustreError: 303873:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6193.132215] LustreError: 303873:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6193.999670] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6194.189255] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6196.521648] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6200.763816] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6204.090515] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6207.504983] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6207.666690] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6210.583103] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6214.381563] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6238.689474] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6238.693643] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6238.705461] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6239.718241] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6241.509669] Lustre: server umount lustre-OST0000 complete [ 6244.833756] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6244.839931] Lustre: Skipped 2 previous similar messages [ 6250.117611] Lustre: server umount lustre-MDT0000 complete [ 6252.211514] LustreError: 303852:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787104262 with bad export cookie 9789281438883243990 [ 6252.218964] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6252.220343] LustreError: 303852:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6252.389564] Lustre: server umount lustre-MDT0001 complete [ 6258.343908] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 6260.149969] Key type lgssc unregistered [ 6260.332564] LNet: 307815:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6260.336407] LNetError: 307815:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6261.352068] LNet: Removed LNI 192.168.201.152@tcp [ 6261.862807] Key type .llcrypt unregistered [ 6261.865235] Key type ._llcrypt unregistered [ 6273.610586] Key type ._llcrypt registered [ 6273.613202] Key type .llcrypt registered [ 6273.674633] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 6282.108786] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 6282.719564] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6282.730134] alg: No test for adler32 (adler32-zlib) [ 6283.674524] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 6283.826716] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 6285.448213] Key type lgssc registered [ 6286.036434] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6298.667294] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 6306.555819] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6306.576762] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6307.703705] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6307.720469] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6307.765961] Lustre: lustre-MDT0000: new disk, initializing [ 6307.805701] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6307.817401] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6310.074294] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6316.682903] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6316.833132] Lustre: lustre-OST0000: new disk, initializing [ 6316.836826] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6316.840084] Lustre: Skipped 1 previous similar message [ 6316.843460] Lustre: 311844:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6316.885367] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6320.445808] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6322.229482] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6322.235867] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6322.259672] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6772.711250] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6772.727723] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6773.395169] Lustre: server umount lustre-MDT0000 complete [ 6775.700428] LustreError: 311843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787104786 with bad export cookie 4111709066699209098 [ 6775.702850] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6775.715688] LustreError: 311843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6777.859466] Lustre: server umount lustre-OST0000 complete [ 6791.640232] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 6797.007411] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 6818.899239] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6819.052907] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6819.070356] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6819.125899] Lustre: lustre-MDT0000: new disk, initializing [ 6819.173818] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6819.183599] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6821.629172] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6828.115081] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6828.191441] Lustre: 316119:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6828.222129] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6828.225022] Lustre: Skipped 1 previous similar message [ 6828.267956] Lustre: lustre-MDT0001: new disk, initializing [ 6828.329995] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6828.358502] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6828.364669] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6830.747569] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6836.212095] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6838.623309] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6841.917468] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6842.067795] Lustre: lustre-OST0000: new disk, initializing [ 6842.071815] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6842.078481] Lustre: 318083:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6842.132358] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6845.359883] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6850.890269] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6852.120680] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6852.133725] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6852.201296] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6853.503339] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6853.660981] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6856.264891] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 6856.394112] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 6857.702073] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6857.710208] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6857.720577] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6862.307688] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6862.308062] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6862.311894] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6863.526834] Lustre: server umount lustre-OST0000 complete [ 6867.426901] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6867.434532] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6867.437632] Lustre: Skipped 2 previous similar messages [ 6871.423280] Lustre: server umount lustre-MDT0000 complete [ 6873.493996] LustreError: 316911:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787104884 with bad export cookie 4111709066702149889 [ 6873.498188] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6873.500235] LustreError: 316911:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6873.710941] Lustre: server umount lustre-MDT0001 complete [ 6875.469535] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 6876.358741] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 22:01:25 (1787104885) [ 6880.022032] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6880.282947] LustreError: 320405:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6880.294720] LustreError: 320405:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6880.339959] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6882.678687] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6885.346883] LustreError: 320406:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6887.341106] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6889.630070] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6893.385108] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6896.059869] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6899.522501] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6899.707302] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6899.713151] Lustre: Skipped 1 previous similar message [ 6902.373169] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6906.186626] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6910.037773] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6910.133292] Lustre: lustre-OST0001: new disk, initializing [ 6910.136784] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6910.141382] Lustre: 323238:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6913.367296] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6918.174601] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6918.180929] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6918.212380] LustreError: 323923:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6919.035803] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6919.135734] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6919.270148] LustreError: 323923:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6919.275074] LustreError: 323923:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 6920.293541] LustreError: 323933:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 6920.302291] LustreError: 323933:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 6922.121040] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff94fe0407a800.ost_server_uuid 50 [ 6922.340390] LustreError: 323933:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 6922.345912] LustreError: 323933:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 6922.836180] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff94fe0407a800.ost_server_uuid in FULL state after 0 sec [ 6925.739403] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff94fe0407a800.ost_server_uuid 50 [ 6926.435608] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff94fe0407a800.ost_server_uuid in FULL state after 0 sec [ 6926.438098] LustreError: 323923:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6926.444486] LustreError: 323923:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 6927.468481] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6942.504078] Lustre: lustre-OST0001: Not available for connect from 192.168.201.52@tcp (stopping) [ 6943.201721] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6943.201929] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6943.204621] LustreError: Skipped 1 previous similar message [ 6943.212955] Lustre: Skipped 2 previous similar messages [ 6944.986515] Lustre: server umount lustre-OST0001 complete [ 6948.837574] LustreError: 324081:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6948.845745] LustreError: 324081:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6949.480725] Lustre: server umount lustre-OST0000 complete [ 6953.953626] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6953.954619] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6953.958729] Lustre: Skipped 2 previous similar messages [ 6953.965460] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6953.969038] Lustre: Skipped 5 previous similar messages [ 6957.593072] Lustre: server umount lustre-MDT0000 complete [ 6959.073156] LustreError: 320405:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6959.080147] LustreError: 320405:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6959.479151] LustreError: 321141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787104970 with bad export cookie 4111709066702150757 [ 6959.482297] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6959.484852] LustreError: 321141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6959.660888] Lustre: server umount lustre-MDT0001 complete [ 6964.774721] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 6966.251947] Key type lgssc unregistered [ 6966.417653] LNet: 325922:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6966.423904] LNetError: 325922:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6966.431576] LNet: Removed LNI 192.168.201.152@tcp [ 6966.859058] Key type .llcrypt unregistered [ 6966.860716] Key type ._llcrypt unregistered [ 6979.602647] Key type ._llcrypt registered [ 6979.604246] Key type .llcrypt registered [ 6979.670739] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 6980.359475] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6980.374787] alg: No test for adler32 (adler32-zlib) [ 6981.299987] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 6981.435579] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 6983.064429] Key type lgssc registered [ 6983.764922] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6988.076816] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6988.087168] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6989.301904] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6991.422315] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 6995.041958] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6998.315787] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6998.521621] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7000.309899] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7005.021761] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7005.187043] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7008.251530] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7009.321245] LustreError: 328999:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7009.334564] LustreError: 328999:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7012.487390] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7014.370616] LustreError: 329463:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7015.396696] LustreError: 328997:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7015.402659] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 7015.406381] LustreError: 328997:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7016.216538] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7016.378706] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7019.953139] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7021.559069] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7024.014160] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7028.525892] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 7028.649740] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7118.817473] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7118.821165] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7118.824324] LustreError: Skipped 1 previous similar message [ 7118.826800] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7118.830930] Lustre: Skipped 1 previous similar message [ 7120.266214] Lustre: server umount lustre-OST0001 complete [ 7122.916483] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7122.922369] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7122.929205] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7122.936259] Lustre: Skipped 1 previous similar message [ 7123.938980] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7123.939912] LustreError: 329000:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7123.941079] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7123.959091] LustreError: 329000:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7128.667466] Lustre: server umount lustre-OST0000 complete [ 7131.617443] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7131.621538] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7131.628172] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7131.631655] Lustre: Skipped 1 previous similar message [ 7136.547801] Lustre: server umount lustre-MDT0000 complete [ 7138.147210] LustreError: 331001:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787105148 with bad export cookie 14049668754990507019 [ 7138.151741] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7138.155166] LustreError: 331001:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7138.304165] Lustre: server umount lustre-MDT0001 complete [ 7143.044455] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 7144.416431] Key type lgssc unregistered [ 7144.596533] LNet: 332260:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7144.600934] LNetError: 332260:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7144.610369] LNet: Removed LNI 192.168.201.152@tcp [ 7144.985245] Key type .llcrypt unregistered [ 7144.986543] Key type ._llcrypt unregistered [ 7165.803119] Key type ._llcrypt registered [ 7165.804184] Key type .llcrypt registered [ 7165.842796] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 7166.242322] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7166.261547] alg: No test for adler32 (adler32-zlib) [ 7167.134813] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 7167.236578] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 7168.824140] Key type lgssc registered [ 7169.203022] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7172.583313] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7172.590174] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7173.741359] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7175.329531] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7179.402940] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7179.612531] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7181.345151] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7182.791746] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7185.889266] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7186.027052] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7188.415110] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7190.118113] LustreError: 336011:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7190.126551] LustreError: 336011:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7191.732954] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7191.819898] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7194.307697] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7199.212191] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 7199.213072] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 7203.150914] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7212.215395] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7218.658857] Lustre: server umount lustre-MDT0000 complete [ 7219.684449] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7219.686283] LustreError: 335733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7219.688740] Lustre: Skipped 3 previous similar messages [ 7219.692838] LustreError: 335733:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7220.044249] LustreError: 334506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787105230 with bad export cookie 4495045342888285578 [ 7220.046761] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7220.048033] LustreError: 334506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7222.190787] Lustre: server umount lustre-MDT0001 complete [ 7234.056725] Lustre: server umount lustre-OST0000 complete [ 7245.658371] Lustre: server umount lustre-OST0001 complete [ 7251.518172] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 7255.116147] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7255.243369] LustreError: 339782:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7255.265939] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7256.727774] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7259.531952] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7261.053225] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7262.150685] Lustre: 340922:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7264.357860] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7264.494645] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7264.496953] Lustre: Skipped 1 previous similar message [ 7265.507713] LustreError: 341460:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7265.511715] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 7266.420360] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7269.454393] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7270.572399] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 7271.709254] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7274.913797] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7276.168630] Lustre: 342792:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7280.096895] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7280.099580] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7280.103701] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7281.121689] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7281.123724] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7281.128336] Lustre: Skipped 2 previous similar messages [ 7283.298837] Lustre: server umount lustre-MDT0000 complete [ 7284.671994] LustreError: 342794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787105295 with bad export cookie 4495045342888287265 [ 7284.676060] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7284.676624] LustreError: 342794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7284.796852] Lustre: server umount lustre-MDT0001 complete [ 7295.429418] Lustre: server umount lustre-OST0000 complete [ 7307.037858] Lustre: server umount lustre-OST0001 complete [ 7308.253254] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 7308.806285] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 7309.462849] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 22:08:39 (1787105319) [ 7317.464077] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 7320.535582] loop0: detected capacity change from 0 to 1099511627776 [ 7320.694280] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 7320.697570] *** VALIDATE xfs *** [ 7320.702142] XFS (loop0): Mounting V5 Filesystem [ 7320.710398] XFS (loop0): Ending clean mount [ 7321.152799] loop1: detected capacity change from 0 to 18691697672192 [ 7341.097391] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 7344.333914] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 7356.212362] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7356.293097] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7356.305402] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7356.340616] Lustre: lustre-MDT0000: new disk, initializing [ 7356.359560] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7356.361463] Lustre: Skipped 1 previous similar message [ 7356.365821] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7357.706024] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7361.753282] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7361.788547] Lustre: 347901:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7361.810377] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7361.812071] Lustre: Skipped 1 previous similar message [ 7361.847249] Lustre: lustre-MDT0001: new disk, initializing [ 7361.891568] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7361.895546] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7363.239670] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7367.078210] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7368.924871] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7371.210043] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7371.309344] Lustre: lustre-OST0000: new disk, initializing [ 7371.311613] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7371.314830] Lustre: 349871:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7372.599102] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7372.602149] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7372.637860] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7373.278271] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7376.913131] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7378.341298] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7378.419858] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7379.853378] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7379.938582] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7383.009715] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7383.010509] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7383.012886] LustreError: Skipped 1 previous similar message [ 7383.012926] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7383.012931] Lustre: Skipped 3 previous similar messages [ 7383.016598] Lustre: Skipped 1 previous similar message [ 7386.718923] Lustre: server umount lustre-OST0000 complete [ 7392.736937] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7392.740040] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7392.745453] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7392.747661] Lustre: Skipped 1 previous similar message [ 7394.271134] Lustre: server umount lustre-MDT0000 complete [ 7395.520321] LustreError: 349870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787105406 with bad export cookie 4495045342888288798 [ 7395.522918] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7395.524497] LustreError: 349870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7395.643592] Lustre: server umount lustre-MDT0001 complete [ 7398.566489] XFS (loop0): Unmounting Filesystem [ 7400.261484] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 22:10:10 (1787105410) [ 7402.466308] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7402.628826] LustreError: 352424:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7402.656482] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7402.659375] Lustre: Skipped 2 previous similar messages [ 7403.976874] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7406.852313] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7408.432513] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7411.097731] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7413.137244] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7415.739600] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7417.778249] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7420.241208] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7437.280948] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7437.284384] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7437.289425] Lustre: Skipped 1 previous similar message [ 7437.291943] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7437.293810] Lustre: Skipped 2 previous similar messages [ 7440.147816] Lustre: server umount lustre-OST0000 complete [ 7442.912954] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7442.916408] LustreError: Skipped 1 previous similar message [ 7447.516186] Lustre: server umount lustre-MDT0000 complete [ 7448.546438] LustreError: 354501:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7448.552901] LustreError: 354501:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7448.808283] LustreError: 352404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787105459 with bad export cookie 4495045342888289680 [ 7448.811662] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7448.812405] LustreError: 352404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7448.921857] Lustre: server umount lustre-MDT0001 complete [ 7452.656540] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 7453.781751] Key type lgssc unregistered [ 7453.918419] LNet: 356080:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7453.921412] LNetError: 356080:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7453.929487] LNet: Removed LNI 192.168.201.152@tcp [ 7454.254139] Key type .llcrypt unregistered [ 7454.255827] Key type ._llcrypt unregistered [ 7464.336370] Key type ._llcrypt registered [ 7464.337482] Key type .llcrypt registered [ 7464.376174] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 7464.766061] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7464.792033] alg: No test for adler32 (adler32-zlib) [ 7465.660781] Lustre: Lustre: Build Version: 2.17.57_1_g147bb23 [ 7465.757703] LNet: Added LNI 192.168.201.152@tcp [8/256/0/180] [ 7467.344195] Key type lgssc registered [ 7467.687712] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7470.140030] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7470.145280] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7471.278885] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7472.624392] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7475.452984] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7475.583105] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7476.980188] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7479.407393] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7481.244415] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7483.553062] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7483.671529] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7485.567441] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7488.042180] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7501.281921] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 7501.284335] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7501.288452] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7501.290318] Lustre: Skipped 1 previous similar message [ 7503.649854] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.52@tcp (stopping) [ 7506.401932] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7506.404135] Lustre: Skipped 1 previous similar message [ 7507.089226] Lustre: server umount lustre-MDT0001 complete [ 7508.761304] LustreError: 357617:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.52@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7508.767107] LustreError: 357617:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7510.396725] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7510.427859] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 7510.429778] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7510.442225] Lustre: 357611:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7510.541650] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7511.773030] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7515.622634] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 7516.646572] LustreError: 361350:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 7516.649292] LustreError: 361350:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 7516.652498] LustreError: 357615:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 7516.670035] LustreError: 361353:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.152@tcp: cfg command failed: rc = -17 [ 7516.673497] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 7516.673497] [ 7815.970616] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.52@tcp (stopping) [ 7817.698274] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 7817.699450] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7817.704773] Lustre: Skipped 2 previous similar messages [ 7819.796875] Lustre: server umount lustre-MDT0001 complete [ 7821.081331] LustreError: 357619:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.52@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7822.818802] LustreError: 357622:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7822.824782] LustreError: 357622:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7823.372977] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7823.409199] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 7823.412627] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7823.430618] Lustre: 357613:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7823.547306] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7824.913911] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 7828.973784] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 7831.527054] LustreError: 374128:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 7831.529370] LustreError: 374128:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 7831.531748] LustreError: 357615:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 7831.533847] LustreError: 357615:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 7831.551084] LustreError: 374131:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 7831.553111] LustreError: 374131:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 7831.554950] LustreError: 374131:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.152@tcp: cfg command failed: rc = -17 [ 7831.558872] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.201.152@tcp [ 7831.558872] [ 8128.287755] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.52@tcp (stopping) [ 8128.289609] Lustre: Skipped 2 previous similar messages [ 8128.996264] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8132.761842] Lustre: server umount lustre-MDT0001 complete [ 8133.402226] LustreError: 358355:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.52@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8136.281215] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8136.310341] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8136.312236] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8136.323937] Lustre: 357613:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8136.438424] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 8137.785151] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 8141.801466] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8145.894184] LustreError: 386800:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8145.896735] LustreError: 386800:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8145.899196] LustreError: 357615:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8145.901938] LustreError: 357615:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8145.921610] LustreError: 386803:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 8145.928771] LustreError: 386803:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.152@tcp: cfg command failed: rc = -114 [ 8145.932846] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 8145.932846] [ 8454.114051] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8454.115287] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8454.116703] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8454.116707] Lustre: Skipped 2 previous similar messages [ 8454.125824] Lustre: Skipped 2 previous similar messages [ 8466.400143] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8466.463691] Lustre: server umount lustre-MDT0000 complete [ 8467.646262] LustreError: 360269:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787106478 with bad export cookie 11701528365734913514 [ 8467.649945] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8467.650163] LustreError: 360269:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8469.473267] LustreError: 363715:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8469.473767] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8469.480915] LustreError: 363715:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8469.489723] Lustre: Skipped 1 previous similar message [ 8472.481308] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8472.483061] Lustre: Skipped 9 previous similar messages [ 8473.882001] Lustre: server umount lustre-MDT0001 complete [ 8475.538409] Lustre: server umount lustre-OST0000 complete [ 8479.249704] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 8482.787765] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 8496.393919] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 22:28:26 (1787106506) [ 8498.707955] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8498.803531] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8498.815081] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8498.855993] Lustre: lustre-MDT0000: new disk, initializing [ 8498.878460] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8498.886167] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8500.273824] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 8504.524173] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8504.571882] Lustre: 401321:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8504.601273] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8504.603177] Lustre: Skipped 1 previous similar message [ 8504.638489] Lustre: lustre-MDT0001: new disk, initializing [ 8504.672691] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8504.684202] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8504.687806] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8506.035964] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 8509.588405] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8512.022684] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8514.754402] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8514.877213] Lustre: lustre-OST0000: new disk, initializing [ 8514.878862] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8514.881420] Lustre: 403288:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8514.917886] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8516.866849] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8516.871089] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8516.913867] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8517.034755] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug -1 all [ 8521.128895] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8525.281036] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8525.284587] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8525.290802] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8529.883697] Lustre: server umount lustre-MDT0000 complete [ 8531.072299] LustreError: 403287:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787106541 with bad export cookie 11701528365734915453 [ 8531.074715] LustreError: 402128:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 8531.075652] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8531.077047] LustreError: 403287:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8531.200665] Lustre: server umount lustre-MDT0001 complete [ 8542.747115] Lustre: server umount lustre-OST0000 complete [ 8551.998242] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid [ 8555.460296] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local [ 8566.099712] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 8267 sec ========== 22:29:35 (1787106575) [ 8566.669818] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 22:29:36 (1787106576) === [ 8567.768341] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 22:29:37 (1787106577) === [ 8581.022043] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing unload_modules_local [ 8582.017909] Key type lgssc unregistered [ 8582.138293] LNet: 409643:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8582.140464] LNetError: 409643:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8582.148308] LNet: Removed LNI 192.168.201.152@tcp [ 8582.450138] Key type .llcrypt unregistered [ 8582.451304] Key type ._llcrypt unregistered