[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 766660919 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001009] APIC: Switch to symmetric I/O mode setup [ 0.002000] x2apic enabled [ 0.002007] Switched APIC routing to physical x2apic. [ 0.003010] kvm-guest: setup PV IPIs [ 0.005518] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.006000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.006000] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.006013] pid_max: default: 32768 minimum: 301 [ 0.007118] LSM: Security Framework initializing [ 0.008044] Yama: becoming mindful. [ 0.009028] SELinux: Initializing. [ 0.010058] *** VALIDATE selinux *** [ 0.019260] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.024076] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.025151] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.026111] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028043] *** VALIDATE tmpfs *** [ 0.029459] *** VALIDATE proc *** [ 0.030245] *** VALIDATE cgroup *** [ 0.031011] *** VALIDATE cgroup2 *** [ 0.032284] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.033157] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.034011] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.035030] Spectre V2 : User space: Vulnerable [ 0.036010] Speculative Store Bypass: Vulnerable [ 0.039182] debug: unmapping init [mem 0xffffffffae059000-0xffffffffae060fff] [ 0.041702] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.043417] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.044025] ... version: 2 [ 0.045017] ... bit width: 48 [ 0.046020] ... generic registers: 4 [ 0.047020] ... value mask: 0000ffffffffffff [ 0.048020] ... max period: 00007fffffffffff [ 0.049020] ... fixed-purpose events: 3 [ 0.050020] ... event mask: 000000070000000f [ 0.051429] rcu: Hierarchical SRCU implementation. [ 0.055643] smp: Bringing up secondary CPUs ... [ 0.056650] x86: Booting SMP configuration: [ 0.057036] .... node #0, CPUs: #1 #2 #3 [ 0.187110] smp: Brought up 1 node, 4 CPUs [ 0.189044] smpboot: Max logical packages: 1 [ 0.190020] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.282870] node 0 deferred pages initialised in 37ms [ 0.287082] devtmpfs: initialized [ 0.288321] x86/mm: Memory block size: 128MB [ 0.290090] gcov: version magic: 0x41383552 [ 0.292724] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.294077] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.297310] pinctrl core: initialized pinctrl subsystem [ 0.299174] [ 0.299962] ************************************************************* [ 0.312017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.318014] ** ** [ 0.322024] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.327013] ** ** [ 0.332012] ** This means that this kernel is built to expose internal ** [ 0.338014] ** IOMMU data structures, which may compromise security on ** [ 0.343015] ** your system. ** [ 0.348015] ** ** [ 0.352017] ** If you see this message and you are not debugging the ** [ 0.358015] ** kernel, report this immediately to your vendor! ** [ 0.363015] ** ** [ 0.370014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.377057] ************************************************************* [ 0.386258] NET: Registered protocol family 16 [ 0.390453] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.396060] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.401064] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.409033] cpuidle: using governor menu [ 0.413468] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.423025] PCI: Using configuration type 1 for base access [ 0.426093] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.433398] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.436073] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.439079] cryptd: max_cpu_qlen set to 1000 [ 0.442161] ACPI: Added _OSI(Module Device) [ 0.444014] ACPI: Added _OSI(Processor Device) [ 0.446013] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.448014] ACPI: Added _OSI(Processor Aggregator Device) [ 0.454763] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.463741] ACPI: Interpreter enabled [ 0.466098] ACPI: PM: (supports S0 S3 S4 S5) [ 0.467013] ACPI: Using IOAPIC for interrupt routing [ 0.468126] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.469524] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.483893] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.486044] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.491024] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.495092] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.501702] acpiphp: Slot [2] registered [ 0.503171] acpiphp: Slot [5] registered [ 0.505175] acpiphp: Slot [6] registered [ 0.507169] acpiphp: Slot [7] registered [ 0.508186] acpiphp: Slot [8] registered [ 0.510122] acpiphp: Slot [9] registered [ 0.512177] acpiphp: Slot [10] registered [ 0.513195] acpiphp: Slot [3] registered [ 0.515098] acpiphp: Slot [4] registered [ 0.516186] acpiphp: Slot [11] registered [ 0.518085] acpiphp: Slot [12] registered [ 0.520117] acpiphp: Slot [13] registered [ 0.521149] acpiphp: Slot [14] registered [ 0.523164] acpiphp: Slot [15] registered [ 0.525083] acpiphp: Slot [16] registered [ 0.526151] acpiphp: Slot [17] registered [ 0.528190] acpiphp: Slot [18] registered [ 0.530097] acpiphp: Slot [19] registered [ 0.532259] acpiphp: Slot [20] registered [ 0.533192] acpiphp: Slot [21] registered [ 0.535161] acpiphp: Slot [22] registered [ 0.537101] acpiphp: Slot [23] registered [ 0.539166] acpiphp: Slot [24] registered [ 0.540142] acpiphp: Slot [25] registered [ 0.542201] acpiphp: Slot [26] registered [ 0.544102] acpiphp: Slot [27] registered [ 0.546103] acpiphp: Slot [28] registered [ 0.548103] acpiphp: Slot [29] registered [ 0.550106] acpiphp: Slot [30] registered [ 0.551697] acpiphp: Slot [31] registered [ 0.553064] PCI host bridge to bus 0000:00 [ 0.555020] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.558023] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.561026] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.567029] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.570021] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.574025] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.576155] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.580356] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.584491] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.595025] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.600884] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.605018] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.609018] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.612019] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.618137] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.622557] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.626049] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.633147] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.641017] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.659017] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.666953] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.675313] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.691066] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.702021] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.722020] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.738572] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.747017] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.756017] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.771000] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.771000] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.772000] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.788026] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.805017] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.815169] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.823021] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.830015] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.851015] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.864585] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.873014] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.880015] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.897017] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.910505] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.920015] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.927015] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.948017] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 1.229429] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 1.257529] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.263754] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 1.296984] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.303174] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 1.314093] iommu: Default domain type: Passthrough [ 1.319108] SCSI subsystem initialized [ 1.321368] ACPI: bus type USB registered [ 1.323183] usbcore: registered new interface driver usbfs [ 1.326163] usbcore: registered new interface driver hub [ 1.329169] usbcore: registered new device driver usb [ 1.332357] pps_core: LinuxPPS API ver. 1 registered [ 1.335034] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.339191] PTP clock support registered [ 1.618075] EDAC MC: Ver: 3.0.0 [ 1.619205] PCI: Using ACPI for IRQ routing [ 1.622070] NetLabel: Initializing [ 1.624009] NetLabel: domain hash size = 128 [ 1.625011] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.628086] NetLabel: unlabeled traffic allowed by default [ 1.631004] vgaarb: loaded [ 1.632477] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.634011] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.642668] clocksource: Switched to clocksource kvm-clock [ 2.378218] VFS: Disk quotas dquot_6.6.0 [ 2.403340] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.427263] *** VALIDATE ramfs *** [ 2.436222] *** VALIDATE hugetlbfs *** [ 2.448485] pnp: PnP ACPI init [ 2.463384] pnp: PnP ACPI: found 6 devices [ 2.925127] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.928056] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.930176] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 2.932486] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.935065] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 2.937571] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 2.940597] NET: Registered protocol family 2 [ 2.943234] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 2.948276] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 2.952272] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 2.957894] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 2.961522] TCP: Hash tables configured (established 65536 bind 65536) [ 2.964483] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 2.967653] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 2.971209] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 2.975819] NET: Registered protocol family 1 [ 2.979135] RPC: Registered named UNIX socket transport module. [ 2.981800] RPC: Registered udp transport module. [ 2.983510] RPC: Registered tcp transport module. [ 2.985221] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 2.987250] NET: Registered protocol family 44 [ 2.988455] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 2.991277] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 2.999563] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 3.009512] PCI: CLS 0 bytes, default 64 [ 3.017907] Unpacking initramfs... [ 5.393785] debug: unmapping init [mem 0xffff8efb7cc54000-0xffff8efb7ffbffff] [ 5.399731] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.403587] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 5.408774] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 6.086505] Initialise system trusted keyrings [ 6.088371] Key type blacklist registered [ 6.093777] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 6.195899] zbud: loaded [ 6.199120] *** VALIDATE nfs *** [ 6.200368] *** VALIDATE nfs4 *** [ 6.202149] pstore: using deflate compression [ 6.206348] Platform Keyring initialized [ 6.599880] NET: Registered protocol family 38 [ 6.602618] Key type asymmetric registered [ 6.604874] Asymmetric key parser 'x509' registered [ 6.610531] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 6.615596] io scheduler mq-deadline registered [ 6.618624] io scheduler kyber registered [ 6.620976] io scheduler bfq registered [ 6.623800] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 6.627829] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 6.631720] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.635714] ACPI: Power Button [PWRF] [ 6.643398] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 6.651330] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 6.718207] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 7.011711] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 7.035946] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 7.065955] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 7.100161] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 7.107473] Non-volatile memory driver v1.3 [ 7.108973] Linux agpgart interface v0.103 [ 7.156366] virtio_blk virtio1: [vda] 139272 512-byte logical blocks (71.3 MB/68.0 MiB) [ 7.160229] vda: detected capacity change from 0 to 71307264 [ 7.179534] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 7.182070] vdb: detected capacity change from 0 to 1073741824 [ 7.200292] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 7.202782] vdc: detected capacity change from 0 to 2621440000 [ 7.221931] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 7.224701] vdd: detected capacity change from 0 to 2621440000 [ 7.242697] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 7.245834] vde: detected capacity change from 0 to 4294967296 [ 7.262568] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 7.265872] vdf: detected capacity change from 0 to 4294967296 [ 7.273466] libphy: Fixed MDIO Bus: probed [ 7.289183] usbcore: registered new interface driver usbserial_generic [ 7.292161] usbserial: USB Serial support registered for generic [ 7.294601] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 7.299772] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 7.301694] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 7.304313] mousedev: PS/2 mouse device common for all mice [ 7.307591] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 7.311195] rtc_cmos 00:05: RTC can wake from S4 [ 7.312303] rtc_cmos 00:05: registered as rtc0 [ 7.312358] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 7.312394] intel_pstate: CPU model not supported [ 7.320540] hid: raw HID events driver (C) Jiri Kosina [ 7.326760] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 7.327143] usbcore: registered new interface driver usbhid [ 7.335696] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 7.336430] usbhid: USB HID core driver [ 7.336610] drop_monitor: Initializing network drop monitor service [ 7.336756] Initializing XFRM netlink socket [ 7.337649] NET: Registered protocol family 10 [ 7.352946] Segment Routing with IPv6 [ 7.354720] NET: Registered protocol family 17 [ 7.356879] mpls_gso: MPLS GSO support [ 7.362394] RAS: Correctable Errors collector initialized. [ 7.364550] AVX version of gcm_enc/dec engaged. [ 7.366180] AES CTR mode by8 optimization enabled [ 7.530503] sched_clock: Marking stable (7530411090, 0)->(10050469608, -2520058518) [ 7.571966] registered taskstats version 1 [ 7.594492] Loading compiled-in X.509 certificates [ 7.610205] zswap: loaded using pool lzo/zbud [ 7.955417] Key type big_key registered [ 7.992476] Key type encrypted registered [ 7.998546] ima: No TPM chip found, activating TPM-bypass! [ 8.006026] ima: Allocated hash algorithm: sha1 [ 8.007582] ima: No architecture policies found [ 8.009689] evm: Initialising EVM extended attributes: [ 8.011824] evm: security.selinux [ 8.017283] evm: security.ima [ 8.018577] evm: security.capability [ 8.021717] evm: HMAC attrs: 0x1 [ 8.026204] rtc_cmos 00:05: setting system clock to 2026-06-18 21:15:15 UTC (1781817315) [ 8.042539] debug: unmapping init [mem 0xffffffffaf003000-0xffffffffaf1fffff] [ 8.047571] debug: unmapping init [mem 0xffffffffadd82000-0xffffffffae058fff] [ 8.061239] Write protecting the kernel read-only data: 28672k [ 8.069982] debug: unmapping init [mem 0xffffffffac403000-0xffffffffac5fffff] [ 8.075104] debug: unmapping init [mem 0xffffffffacd14000-0xffffffffacdfffff] [ 8.633506] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 8.640701] systemd[1]: Detected virtualization kvm. [ 8.642186] systemd[1]: Detected architecture x86-64. [ 8.643541] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 8.670239] systemd[1]: No hostname configured. [ 8.671395] systemd[1]: Set hostname to . [ 8.673426] random: systemd: uninitialized urandom read (16 bytes read) [ 8.676173] systemd[1]: Initializing machine ID from random generator. [ 8.827895] random: ln: uninitialized urandom read (6 bytes read) [ 8.978865] random: systemd: uninitialized urandom read (16 bytes read) [ 8.982755] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 8.990666] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 9.001593] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ OK ] Listening on Journal Socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Timers. Starting Journal Service... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target Swap. Starting Create Volatile Files and Directories... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. Starting Setup Virtual Console... Starting Apply Kernel Variables... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 13.217640] device-mapper: uevent: version 1.0.3 [ 13.225654] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 15.884897] virtio_net virtio0 ens2: renamed from eth0 [ 15.960837] random: fast init done [ 16.152333] scsi host0: ata_piix [ 16.173161] scsi host1: ata_piix [ 16.178231] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 16.184905] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 21.541763] random: crng init done [ 21.544248] random: 7 urandom warning(s) missed due to ratelimiting [ 23.908747] dracut-initqueue[585]: RTNETLINK answers: File exists [ 25.484014] hrtimer: interrupt took 6014056 ns Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 26.484744] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 30.874487] printk: systemd: 26 output lines suppressed due to ratelimiting [ 32.167896] SELinux: Disabled at runtime. [ 32.354410] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 32.388701] systemd[1]: Detected virtualization kvm. [ 32.390599] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 34.886651] systemd[1]: initrd-switch-root.service: Succeeded. [ 34.900549] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 34.940978] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 34.948967] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 34.959079] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 34.983016] systemd[1]: Starting Journal Service... Starting Journal Service... [ 35.004809] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. Mounting Huge Pages File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on udev Kernel Socket. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on RPCbind Server Activation Socket. Mounting Kernel Debug File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-getty.slice. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Dispatch Password Requests to Console Directory Watch. Starting Apply Kernel Variables... [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... Activating swap /dev/disk/by-label/SWAP... [ OK ] Reached target Paths. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target L[ 35.805233] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS ocal Encrypted Volumes. Mounting POSIX Message Queue File System... Starting Remount Root and Kernel File Systems... [ OK ] Mounted Huge Pages File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted POSIX Message Queue File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 37.313566] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 38.885114] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 39.046622] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 39.985949] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 40.160142] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (9s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit)[ 45.673804] Key type dns_resolver registered [ ***] A start job is running for Configur…only root support (11s / no limit) [ **] A start job is running for Configur…only root support (11s / no limit)[ 46.660478] NFS: Registering the id_resolver key type [ 46.672115] Key type id_resolver registered [ 46.677833] Key type id_legacy registered [ *] A start job is running for Configur…only root support (12s / no limit) [ **] A start job is running for Configur…only root support (12s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Login Service... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started Login Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg257-server login: [ 95.959208] libcfs: loading out-of-tree module taints kernel. [ 95.992265] Key type ._llcrypt registered [ 95.994089] Key type .llcrypt registered [ 96.055655] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 108.693525] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 109.945586] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 109.955625] alg: No test for adler32 (adler32-zlib) [ 111.277858] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 111.986867] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 113.719301] Key type lgssc registered [ 115.021769] Lustre: Echo OBD driver; http://www.lustre.org/ [ 127.824765] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 156.528402] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 165.834973] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 165.862555] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 167.057708] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 167.083923] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 167.138280] Lustre: lustre-MDT0000: new disk, initializing [ 167.176222] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 167.187793] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 169.925915] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 179.167855] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 179.263247] Lustre: 6510:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 179.289629] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 179.295070] Lustre: Skipped 1 previous similar message [ 179.395971] Lustre: lustre-MDT0001: new disk, initializing [ 179.447716] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 179.462841] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 179.468899] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 182.519370] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 185.863914] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 191.782481] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 191.934949] Lustre: lustre-OST0000: new disk, initializing [ 191.939348] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 191.946625] Lustre: 8446:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 191.989228] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 195.689184] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 199.209178] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 199.215301] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 199.277070] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 206.419557] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 206.528543] Lustre: lustre-OST0001: new disk, initializing [ 206.533697] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 206.541320] Lustre: 9519:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 206.583923] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 210.943215] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 214.561473] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 214.570881] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 214.655122] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 219.452766] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 225.392401] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 229.403104] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing check_logdir /tmp/testlogs/ [ 233.055929] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing yml_node [ 235.802512] Lustre: DEBUG MARKER: Client: 2.17.54.40 [ 237.571663] Lustre: DEBUG MARKER: MDS: 2.17.54.40 [ 239.192750] Lustre: DEBUG MARKER: OSS: 2.17.54.40 [ 240.181143] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Jun 18 17:19:07 EDT 2026 [ 249.674665] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 250.858193] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 265.696474] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 265.697480] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 265.703027] Lustre: Skipped 2 previous similar messages [ 265.711404] Lustre: Skipped 1 previous similar message [ 270.816734] Lustre: server umount lustre-MDT0000 complete [ 273.494889] LustreError: 6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781817580 with bad export cookie 4272990404313938745 [ 273.503953] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 273.506284] LustreError: 6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 275.946408] LustreError: 6517:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 275.946882] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 275.948969] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 275.958340] LustreError: 6517:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 275.974114] Lustre: Skipped 2 previous similar messages [ 278.946704] LustreError: 6515:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 278.946903] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 278.966597] LustreError: 6515:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 278.979736] Lustre: Skipped 2 previous similar messages [ 279.845285] Lustre: server umount lustre-MDT0001 complete [ 282.596935] Lustre: server umount lustre-OST0000 complete [ 285.553882] Lustre: server umount lustre-OST0001 complete [ 290.703215] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 298.571345] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 323.520450] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 323.699229] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 323.720131] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 323.784691] Lustre: lustre-MDT0000: new disk, initializing [ 323.841393] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 323.859195] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 326.839530] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 334.879471] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 334.946429] Lustre: 15059:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 334.999863] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 335.004932] Lustre: Skipped 1 previous similar message [ 335.063279] Lustre: lustre-MDT0001: new disk, initializing [ 335.167943] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 335.204051] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 335.211988] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 338.773396] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 345.288923] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 348.793553] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 353.195318] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 353.493672] Lustre: lustre-OST0000: new disk, initializing [ 353.499253] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 353.505984] Lustre: 17029:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 353.606288] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 355.295278] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 355.300284] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 355.372879] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 358.197214] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 365.302437] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 369.182284] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 369.447181] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 372.622995] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 372.759352] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 375.777641] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 375.792611] Lustre: Skipped 1 previous similar message [ 375.792652] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 380.350961] Lustre: server umount lustre-OST0000 complete [ 386.018060] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 386.018892] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 386.030741] Lustre: Skipped 1 previous similar message [ 386.040846] Lustre: Skipped 2 previous similar messages [ 396.259955] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 396.271955] Lustre: Skipped 3 previous similar messages [ 397.281690] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 397.417789] Lustre: server umount lustre-MDT0000 complete [ 399.949134] LustreError: 15052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781817707 with bad export cookie 4272990404313940278 [ 399.955858] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 399.956398] LustreError: 15052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 400.123837] Lustre: server umount lustre-MDT0001 complete [ 403.394493] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 17:21:50 (1781817710) [ 408.139449] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 408.431646] LustreError: 19292:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 408.491744] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 411.599165] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 413.667834] LustreError: 19293:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 417.763211] LustreError: 19292:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 417.930395] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 421.475260] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 426.489915] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 430.378825] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 434.936197] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 439.628759] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 444.846863] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 458.022543] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 464.353178] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 464.362490] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 464.382180] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 469.128873] Lustre: server umount lustre-MDT0000 complete [ 471.411820] LustreError: 21134:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781817778 with bad export cookie 4272990404313941160 [ 471.422826] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 471.427032] LustreError: 21134:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 471.612661] Lustre: server umount lustre-MDT0001 complete [ 484.395889] Lustre: server umount lustre-OST0000 complete [ 499.179921] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 506.194608] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 506.417164] LustreError: 23691:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 506.450657] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 506.453451] Lustre: Skipped 2 previous similar messages [ 509.221972] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 515.367391] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 518.281246] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 520.342804] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 525.275635] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 529.954845] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 536.004912] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 536.130552] Lustre: lustre-OST0001: new disk, initializing [ 536.133698] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 536.138212] Lustre: 26004:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 537.958383] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 537.967884] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 538.037729] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 540.973333] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 547.716195] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 550.064918] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 556.514673] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 556.518281] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 556.523594] Lustre: Skipped 2 previous similar messages [ 556.526336] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 556.528995] Lustre: Skipped 3 previous similar messages [ 563.682852] LustreError: 23691:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 563.693696] LustreError: 23691:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 564.482898] Lustre: server umount lustre-MDT0000 complete [ 566.904028] LustreError: 23672:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781817874 with bad export cookie 4272990404313942007 [ 566.904317] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 566.911565] LustreError: 23672:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 567.071614] Lustre: server umount lustre-MDT0001 complete [ 579.808921] Lustre: server umount lustre-OST0000 complete [ 590.786409] Lustre: server umount lustre-OST0001 complete [ 598.661493] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 604.279332] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 604.507034] LustreError: 28971:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 607.350541] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 612.580017] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 615.634707] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 617.284690] Lustre: 30119:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 621.354919] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 625.207665] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 630.895861] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 634.900824] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 639.869835] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 642.277746] Lustre: 31996:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 646.629099] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 646.632965] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 646.640558] Lustre: Skipped 5 previous similar messages [ 646.653065] Lustre: Skipped 7 previous similar messages [ 651.565463] Lustre: server umount lustre-MDT0000 complete [ 653.790308] LustreError: 28953:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781817961 with bad export cookie 4272990404313943302 [ 653.793967] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 653.795021] LustreError: 28953:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 653.970723] Lustre: server umount lustre-MDT0001 complete [ 666.133726] Lustre: server umount lustre-OST0000 complete [ 677.855375] Lustre: server umount lustre-OST0001 complete [ 680.890032] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 17:26:28 (1781817988) [ 691.634298] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 695.806512] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 695.967202] LustreError: 34796:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 695.975571] LustreError: 34796:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 696.002494] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 696.005278] Lustre: Skipped 7 previous similar messages [ 697.454608] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 700.592643] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 702.264081] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 703.450333] Lustre: 35943:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 705.848614] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 708.068393] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 711.162258] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 713.375032] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 716.854972] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 718.234841] Lustre: 37819:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 721.376750] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 721.380796] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 721.387212] Lustre: Skipped 1 previous similar message [ 725.852586] Lustre: server umount lustre-MDT0000 complete [ 727.192441] LustreError: 37823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781818034 with bad export cookie 4272990404313944408 [ 727.195825] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 727.197539] LustreError: 37823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 727.313324] Lustre: server umount lustre-MDT0001 complete [ 739.332580] Lustre: server umount lustre-OST0000 complete [ 750.940317] Lustre: server umount lustre-OST0001 complete [ 754.047561] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 17:27:41 (1781818061) [ 759.634065] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 763.271490] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 765.024397] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 768.477570] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 770.197390] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 771.262336] Lustre: 41105:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 773.789163] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 776.054270] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 779.374892] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 781.644518] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 795.388901] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 796.923330] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 796.925881] Lustre: Skipped 1 previous similar message [ 798.177205] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 798.179707] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 798.181657] Lustre: Skipped 5 previous similar messages [ 798.184251] Lustre: Skipped 5 previous similar messages [ 804.187869] Lustre: server umount lustre-MDT0000 complete [ 805.598817] LustreError: 43007:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781818113 with bad export cookie 4272990404313945493 [ 805.600426] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 805.603035] LustreError: 43007:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 811.762828] Lustre: server umount lustre-MDT0001 complete [ 814.727050] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 815.586525] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x3b4cb62229c919cb [ 815.591771] Lustre: MGC192.168.202.157@tcp: Connection restored to 0@lo (at 0@lo) [ 817.182292] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 820.087922] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 821.681847] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 824.255392] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 835.295711] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 10 sec [ 835.558557] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 837.366325] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 837.922208] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 840.675931] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 845.342467] Lustre: server umount lustre-MDT0000 complete [ 846.744554] LustreError: 39938:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781818154 with bad export cookie 4272990404313946571 [ 846.749084] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 846.749500] LustreError: 39938:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 846.816449] LustreError: 43876:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 846.822875] LustreError: 43876:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 18 previous similar messages [ 846.892587] Lustre: server umount lustre-MDT0001 complete [ 854.525632] Lustre: server umount lustre-OST0000 complete [ 855.814562] Lustre: server umount lustre-OST0001 complete [ 858.667589] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 17:29:26 (1781818166) [ 863.866356] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 867.542518] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 869.173702] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 872.233645] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 873.974404] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 875.056444] Lustre: 48772:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 875.061207] Lustre: 48772:0:(mgs_llog.c:1447:mgs_modify_param()) Skipped 1 previous similar message [ 877.385834] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 879.718883] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 882.709414] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 884.875269] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 888.175618] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 889.760561] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 898.016851] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 900.447145] Lustre: server umount lustre-MDT0000 complete [ 901.950399] Lustre: server umount lustre-MDT0001 complete [ 912.837667] Lustre: server umount lustre-OST0000 complete [ 924.456544] Lustre: server umount lustre-OST0001 complete [ 927.854761] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 17:30:35 (1781818235) [ 928.704072] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 929.299246] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 17:30:36 (1781818236) [ 932.946904] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 935.915638] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 943.530367] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 943.633333] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 943.670223] Lustre: lustre-MDT0000: new disk, initializing [ 943.700260] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 945.124579] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 948.790252] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 950.869382] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 950.968702] Lustre: 54849:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 952.189354] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 952.196729] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 952.832291] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 956.411636] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 957.094876] Lustre: DEBUG MARKER: create test files [ 967.648357] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 967.648404] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 967.653026] Lustre: Skipped 11 previous similar messages [ 973.443951] Lustre: server umount lustre-OST0000 complete [ 974.854252] Lustre: server umount lustre-MDT0000 complete [ 979.827882] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 980.974113] Key type lgssc unregistered [ 981.109936] LNet: 56452:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 982.181331] LNet: Removed LNI 192.168.202.157@tcp [ 982.602143] Key type .llcrypt unregistered [ 982.603729] Key type ._llcrypt unregistered [ 1001.770990] Key type ._llcrypt registered [ 1001.773446] Key type .llcrypt registered [ 1001.846846] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 1002.487336] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1002.621831] alg: No test for adler32 (adler32-zlib) [ 1003.562621] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 1003.699352] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 1005.319181] Key type lgssc registered [ 1006.134173] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1011.837843] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1011.856267] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1013.279698] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1016.370394] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1021.217952] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1025.069731] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1025.272215] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1028.352729] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1032.106122] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1037.540286] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1037.567019] Lustre: 59164:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1037.570867] Lustre: 59164:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1037.574630] Lustre: 59164:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1037.578072] Lustre: 59164:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1037.582971] Lustre: 59164:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1037.586928] Lustre: 59164:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1045.819909] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1047.963083] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1053.154080] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1053.154515] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1053.169448] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1056.276665] Lustre: server umount lustre-OST0000 complete [ 1057.763382] Lustre: server umount lustre-MDT0000 complete [ 1062.832297] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 1064.095855] Key type lgssc unregistered [ 1064.258743] LNet: 60794:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1065.317606] LNet: Removed LNI 192.168.202.157@tcp [ 1065.677823] Key type .llcrypt unregistered [ 1065.679384] Key type ._llcrypt unregistered [ 1079.402704] Key type ._llcrypt registered [ 1079.403889] Key type .llcrypt registered [ 1079.451860] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 1079.901163] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1079.915854] alg: No test for adler32 (adler32-zlib) [ 1080.819532] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 1080.956023] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 1082.559182] Key type lgssc registered [ 1083.020660] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1086.210180] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1086.224509] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1087.475336] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1089.131145] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1091.956852] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1094.774278] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1094.896297] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1096.934523] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1096.959335] Lustre: 63605:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1096.963580] Lustre: 63605:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1096.966171] Lustre: 63605:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1096.968768] Lustre: 63605:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1096.971677] Lustre: 63605:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1096.974331] Lustre: 63605:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1097.170655] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1099.874944] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1103.180692] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1107.424671] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1107.431825] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1112.544302] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1113.120923] Lustre: server umount lustre-OST0000 complete [ 1114.827662] Lustre: server umount lustre-MDT0000 complete [ 1119.677101] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 1120.887619] Key type lgssc unregistered [ 1121.030413] LNet: 65161:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1122.089114] LNet: Removed LNI 192.168.202.157@tcp [ 1122.465284] Key type .llcrypt unregistered [ 1122.467147] Key type ._llcrypt unregistered [ 1130.030119] Key type ._llcrypt registered [ 1130.031757] Key type .llcrypt registered [ 1130.077021] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 1137.146147] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 1137.490755] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1137.497319] alg: No test for adler32 (adler32-zlib) [ 1138.369523] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 1138.456332] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 1140.047164] Key type lgssc registered [ 1140.473911] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1153.889182] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1153.894776] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1154.982195] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1154.997819] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1155.038443] Lustre: lustre-MDT0000: new disk, initializing [ 1155.085443] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1155.093111] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1156.530332] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1161.023347] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1161.071547] Lustre: 68287:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1161.112048] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1161.115168] Lustre: Skipped 1 previous similar message [ 1161.153993] Lustre: lustre-MDT0001: new disk, initializing [ 1161.195682] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1161.214218] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1161.218056] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1162.733557] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1167.032638] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1169.418890] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1172.531120] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1172.663039] Lustre: lustre-OST0000: new disk, initializing [ 1172.665870] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1172.669856] Lustre: 70255:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1172.711442] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1172.993531] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1172.997060] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1173.058357] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1175.017509] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1179.022797] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1180.656821] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1180.727215] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1182.285152] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1182.378164] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1183.200842] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1183.202471] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1183.203637] LustreError: Skipped 1 previous similar message [ 1183.213672] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1183.218900] Lustre: Skipped 1 previous similar message [ 1188.323665] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1188.326022] Lustre: Skipped 1 previous similar message [ 1189.265741] Lustre: server umount lustre-OST0000 complete [ 1191.903986] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1191.906396] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1191.909710] Lustre: Skipped 1 previous similar message [ 1191.911329] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1193.440855] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1196.631682] Lustre: server umount lustre-MDT0000 complete [ 1198.056639] LustreError: 69081:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781818505 with bad export cookie 12001275307019965020 [ 1198.061569] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1198.061683] LustreError: 69081:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1198.195242] Lustre: server umount lustre-MDT0001 complete [ 1201.416714] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 17:35:08 (1781818508) [ 1205.074754] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 1217.904862] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 1220.908745] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 1233.032904] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1233.124636] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1233.135544] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1233.170151] Lustre: lustre-MDT0000: new disk, initializing [ 1233.191733] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1233.200163] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1234.601169] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1238.959403] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1239.000275] Lustre: 76261:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1239.022757] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1239.025186] Lustre: Skipped 1 previous similar message [ 1239.060056] Lustre: lustre-MDT0001: new disk, initializing [ 1239.094052] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1239.108887] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1239.112588] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1240.450935] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1244.039499] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1245.875747] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1248.186857] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1248.285486] Lustre: lustre-OST0000: new disk, initializing [ 1248.287643] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1248.290279] Lustre: 78229:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1248.318981] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1250.215583] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1253.848663] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1255.196792] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1256.436806] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1256.439738] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1256.469536] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1257.315282] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 1258.657518] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1258.723314] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1261.536462] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1261.538126] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1261.539359] LustreError: Skipped 1 previous similar message [ 1261.539976] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1261.544244] Lustre: Skipped 1 previous similar message [ 1261.548629] Lustre: Skipped 3 previous similar messages [ 1265.490354] Lustre: server umount lustre-OST0000 complete [ 1269.727952] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1269.731094] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1269.736699] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1272.993797] Lustre: server umount lustre-MDT0000 complete [ 1274.479217] LustreError: 77057:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781818581 with bad export cookie 12001275307019965909 [ 1274.483051] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1274.485576] LustreError: 77057:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1274.615862] Lustre: server umount lustre-MDT0001 complete [ 1278.479734] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 17:36:25 (1781818585) [ 1281.817163] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1282.066372] LustreError: 80652:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1282.073047] LustreError: 80652:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 1282.099259] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1284.910053] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1287.137593] LustreError: 80653:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1292.261218] LustreError: 80652:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1292.591378] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1296.855676] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1302.855760] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1308.359923] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1315.341398] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1315.556404] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1315.562437] Lustre: Skipped 1 previous similar message [ 1322.081857] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1327.330574] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1330.036211] Lustre: 83325:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 38b73390-1f11-45d4-8954-4c85d4f0197b at adminstrative request [ 1332.195491] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1332.202814] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1342.437581] Lustre: MGS: Client 38b73390-1f11-45d4-8954-4c85d4f0197b (at 0@lo) reconnecting [ 1342.459308] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xa68d184e66979939 to 0xa68d184e66979bd9 [ 1342.480345] Lustre: MGC192.168.202.157@tcp: Connection restored to 0@lo (at 0@lo) [ 1371.048384] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1371.245720] Lustre: lustre-OST0001: new disk, initializing [ 1371.252963] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1371.262509] Lustre: 83718:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1381.879159] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1381.941435] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1382.600414] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1383.867906] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1401.732770] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1407.971619] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1407.974224] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1408.001555] LustreError: Skipped 1 previous similar message [ 1408.006377] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1408.006386] Lustre: Skipped 2 previous similar messages [ 1408.041724] Lustre: Skipped 2 previous similar messages [ 1411.396329] Lustre: server umount lustre-OST0001 complete [ 1416.164832] LustreError: 82475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1416.185836] LustreError: 82475:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1421.285208] LustreError: 82478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1421.315629] LustreError: 82478:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1426.403339] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1426.413090] Lustre: Skipped 8 previous similar messages [ 1429.983532] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1430.280624] Lustre: server umount lustre-OST0000 complete [ 1436.642352] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1436.642654] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1436.656443] Lustre: Skipped 2 previous similar messages [ 1441.352544] Lustre: server umount lustre-MDT0000 complete [ 1441.760953] LustreError: 80647:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1441.777891] LustreError: 80647:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1446.615898] LustreError: 80679:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781818754 with bad export cookie 12001275307019967449 [ 1446.630982] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1446.635984] LustreError: 80679:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1446.993777] Lustre: server umount lustre-MDT0001 complete [ 1455.852405] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 17:39:22 (1781818762) [ 1457.784830] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1459.946843] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 17:39:26 (1781818766) [ 1461.697574] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1463.543451] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 17:39:29 (1781818769) [ 1465.262437] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1467.627490] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 17:39:33 (1781818773) [ 1469.134531] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1470.658438] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 17:39:37 (1781818777) [ 1472.230781] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1478.135857] loop: module loaded [ 1478.154402] loop0: detected capacity change from 0 to 4294967296 [ 1478.227256] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1479.709945] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1483.527438] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1487.383869] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1515.194088] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1515.232338] LustreError: 87849:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1515.236606] LustreError: 87849:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1515.241567] LustreError: 87849:0:(tgt_mount.c:2534:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1515.247830] LustreError: 87849:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1538.815330] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 1552.381406] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 1592.337703] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1592.498581] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1592.515687] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1592.566135] Lustre: lustre-MDT0000: new disk, initializing [ 1592.612310] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1592.615196] Lustre: Skipped 1 previous similar message [ 1592.632648] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1597.541076] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1609.317038] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1609.482887] Lustre: 90714:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1609.811600] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1614.928765] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1625.743425] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1632.311288] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1640.465611] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1640.892040] Lustre: 92686:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1647.224411] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1647.410678] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1648.451901] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1659.158708] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1665.245641] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1665.590504] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1671.108063] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1671.496479] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1678.313618] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1678.314337] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1678.320648] Lustre: Skipped 1 previous similar message [ 1678.323131] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1678.329245] LustreError: Skipped 1 previous similar message [ 1678.332634] Lustre: Skipped 2 previous similar messages [ 1679.596602] Lustre: server umount lustre-OST0000 complete [ 1689.925032] Lustre: server umount lustre-MDT0000 complete [ 1693.688425] LustreError: 91882:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1693.721957] LustreError: 91882:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1694.202102] LustreError: 90708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781819001 with bad export cookie 12001275307019968065 [ 1694.217688] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1694.225877] LustreError: 90708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1694.676722] Lustre: server umount lustre-MDT0001 complete [ 1704.889677] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 17:43:31 (1781819011) [ 1712.599876] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1718.908793] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1727.973416] LustreError: 95100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1728.003608] LustreError: 95100:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1728.258211] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1728.538672] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 1728.547446] Lustre: Skipped 3 previous similar messages [ 1733.523818] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1740.488924] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1745.984979] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1751.801754] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1756.769459] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1763.294391] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1767.466945] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1767.643668] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1771.144620] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1771.315463] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1776.403756] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1776.515625] Lustre: lustre-OST0001: new disk, initializing [ 1776.518394] Lustre: Skipped 2 previous similar messages [ 1776.521970] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1776.526251] Lustre: Skipped 3 previous similar messages [ 1776.530364] Lustre: 98472:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1781.438506] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1783.855129] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1783.860936] Lustre: Skipped 2 previous similar messages [ 1783.865788] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1783.961485] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1788.176455] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1791.016077] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1791.173770] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1794.103312] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1794.214840] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1807.037637] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1821.286349] Lustre: Failing over lustre-MDT0000 [ 1821.335818] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.57@tcp (stopping) [ 1821.345432] Lustre: Skipped 6 previous similar messages [ 1821.610917] Lustre: server umount lustre-MDT0000 complete [ 1825.250922] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1825.255817] Lustre: Skipped 3 previous similar messages [ 1825.257839] LustreError: 97904:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1825.265044] LustreError: 97904:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1839.046576] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1839.050735] LDISKFS-fs (dm-0): recovery complete [ 1839.055080] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1839.133893] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1839.309052] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1841.484364] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 1841.793454] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1841.793586] Lustre: 97904:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1844.707603] Lustre: 95829:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1844.714391] Lustre: 95829:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 1 previous similar message [ 1844.726424] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1844.752702] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1845.063130] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1845.377387] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1845.382907] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 1845.703613] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1845.716756] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 1845.725038] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1845.731370] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 7 previous similar messages [ 1846.673561] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1846.677731] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 3 previous similar messages [ 1846.991099] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1847.006051] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 3 previous similar messages [ 1847.961392] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1847.968872] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 6 previous similar messages [ 1848.920181] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1848.926677] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 1849.239205] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1849.246244] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 1852.081504] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1852.087195] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 12 previous similar messages [ 1853.026236] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1853.030712] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 1853.351131] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1853.355424] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 1860.296902] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1860.304772] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 25 previous similar messages [ 1861.249471] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1861.253852] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 25 previous similar messages [ 1861.567082] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1861.574547] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 25 previous similar messages [ 1876.330367] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1876.334576] Lustre: 101316:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 50 previous similar messages [ 1877.272035] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1877.276545] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 50 previous similar messages [ 1877.591135] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1877.594407] LustreError: 101316:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 50 previous similar messages [ 1901.087171] Lustre: 101316:0:(ldlm_lib.c:2380:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1901.091266] Lustre: 101316:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1901.096210] Lustre: 101316:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 2e8e92ee-65c5-4dae-b4e0-417d87c95f5e@192.168.202.57@tcp [ 1901.100872] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1901.103228] Lustre: 101316:0:(ldlm_lib.c:1900:abort_req_replay_queue()) @@@ aborted: req@000000005bf130ea x1868372051561216/t0(8589934776) o35->2e8e92ee-65c5-4dae-b4e0-417d87c95f5e@192.168.202.57@tcp:344/0 lens 392/0 e 0 to 0 dl 1781819219 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1901.115080] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1901.119490] Lustre: lustre-MDT0000: Denying connection for new client 2e8e92ee-65c5-4dae-b4e0-417d87c95f5e (at 192.168.202.57@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1901.123783] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1901.148188] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1901.151614] Lustre: Skipped 2 previous similar messages [ 1901.152593] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1901.169546] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 1901.169697] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 1916.357599] Lustre: server umount lustre-OST0000 complete [ 1933.279128] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1933.370233] Lustre: server umount lustre-OST0001 complete [ 1941.673312] Lustre: server umount lustre-MDT0000 complete [ 1943.882491] LustreError: 95080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781819251 with bad export cookie 12001275307020019277 [ 1943.883332] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1943.889498] LustreError: 95080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1944.071880] Lustre: server umount lustre-MDT0001 complete [ 1948.839603] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 17:47:36 (1781819256) [ 1953.254137] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1953.259817] Lustre: *** cfs_fail_loc=197, val=0*** [ 1968.735562] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1973.855557] LustreError: 103288:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.157@tcp: failed processing log, type 4: rc = -110 [ 1978.997029] Lustre: *** cfs_fail_loc=197, val=0*** [ 1978.999677] Lustre: Skipped 65 previous similar messages [ 1999.519239] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1999.522036] Lustre: Skipped 3 previous similar messages [ 2002.860603] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2007.242237] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2008.601928] Lustre: server umount lustre-OST0000 complete [ 2013.890841] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 17:48:41 (1781819321) [ 2031.625792] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2032.000457] LustreError: 104907:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2032.016218] LustreError: 104907:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 26 previous similar messages [ 2034.942870] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2041.996664] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2045.193212] LustreError: 104938:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2045.197382] LustreError: 104938:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2045.205060] LustreError: 104938:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 13, retries 0, failed: rc = -5 [ 2045.419349] Lustre: server umount lustre-MDT0000 complete [ 2065.349784] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 2070.713749] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2093.052302] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2093.350913] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2093.378713] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2093.453144] Lustre: lustre-MDT0000: new disk, initializing [ 2093.534185] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2098.006369] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2109.638353] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2109.884737] Lustre: 109105:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2110.318090] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2114.008127] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2119.547632] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2122.830181] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2127.665037] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2127.953436] Lustre: 111074:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2132.640947] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2135.711662] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2140.796616] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2144.804792] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2144.936564] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2149.780373] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2150.070509] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2156.516966] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2156.521084] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2156.527297] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2156.527304] Lustre: Skipped 10 previous similar messages [ 2156.559861] Lustre: Skipped 7 previous similar messages [ 2166.239165] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2166.442808] Lustre: server umount lustre-OST0000 complete [ 2175.572122] Lustre: server umount lustre-MDT0000 complete [ 2178.147845] LustreError: 111073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781819485 with bad export cookie 12001275307020029938 [ 2178.157120] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2178.162097] LustreError: 111073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2178.454541] Lustre: server umount lustre-MDT0001 complete [ 2183.689193] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 17:51:30 (1781819490) [ 2189.484934] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 2191.179251] Key type lgssc unregistered [ 2191.380063] LNet: 113561:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2192.421668] LNet: Removed LNI 192.168.202.157@tcp [ 2193.000503] Key type .llcrypt unregistered [ 2193.006326] Key type ._llcrypt unregistered [ 2202.217273] Key type ._llcrypt registered [ 2202.219163] Key type .llcrypt registered [ 2202.262406] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 2210.944975] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2211.590740] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2211.611180] alg: No test for adler32 (adler32-zlib) [ 2212.731771] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 2212.909408] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 2214.543261] Key type lgssc registered [ 2215.599997] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2240.026855] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2240.040237] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2241.222403] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2241.253397] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2241.332436] Lustre: lustre-MDT0000: new disk, initializing [ 2241.383505] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2241.403378] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2245.147400] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2252.737672] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2252.904850] Lustre: lustre-OST0000: new disk, initializing [ 2252.907780] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2252.910833] Lustre: Skipped 1 previous similar message [ 2252.914477] Lustre: 117709:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2252.956211] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2256.903453] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2260.508578] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2260.516405] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2260.534659] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2263.514527] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2263.656878] Lustre: lustre-OST0001: new disk, initializing [ 2263.661698] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2263.667226] Lustre: 118570:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2263.714688] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2266.159510] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2266.162287] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2266.175949] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2266.727564] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2276.321544] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2276.323898] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2276.327839] Lustre: Skipped 1 previous similar message [ 2276.331820] Lustre: Skipped 1 previous similar message [ 2278.107188] Lustre: server umount lustre-MDT0000 complete [ 2281.316038] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2283.943182] LustreError: 116895:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781819591 with bad export cookie 11981939313123291592 [ 2283.953501] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2283.954243] LustreError: 116895:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2284.019825] Lustre: server umount lustre-OST0000 complete [ 2286.326867] Lustre: server umount lustre-OST0001 complete [ 2291.905671] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 17:53:18 (1781819598) [ 2298.110805] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2314.351828] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 17:53:41 (1781819621) [ 2347.289250] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 2354.219967] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2381.542235] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2381.728920] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2381.766473] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2381.836436] Lustre: lustre-MDT0000: new disk, initializing [ 2381.899339] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2381.912209] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2385.275878] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2394.071452] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2394.187187] Lustre: 125314:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2394.257989] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2394.266181] Lustre: Skipped 1 previous similar message [ 2394.378120] Lustre: lustre-MDT0001: new disk, initializing [ 2394.471456] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2394.526039] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2394.546161] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2397.581747] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2404.249839] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2408.988627] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2414.318133] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2414.743887] Lustre: lustre-OST0000: new disk, initializing [ 2414.756084] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2414.767492] Lustre: 127284:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2414.924274] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2420.699395] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2420.800402] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2420.806536] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2420.923470] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2426.439196] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2428.273772] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2428.408593] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2430.213857] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2430.294018] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2431.456761] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2431.458096] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2431.461244] LustreError: Skipped 1 previous similar message [ 2431.462383] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2431.467068] Lustre: Skipped 1 previous similar message [ 2433.210364] Lustre: server umount lustre-OST0000 complete [ 2436.577943] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2436.578788] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2436.583529] Lustre: Skipped 1 previous similar message [ 2436.585379] Lustre: Skipped 1 previous similar message [ 2441.698040] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2441.702984] Lustre: Skipped 1 previous similar message [ 2442.093750] Lustre: server umount lustre-MDT0000 complete [ 2445.215089] LustreError: 125306:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781819752 with bad export cookie 11981939313123292810 [ 2445.220044] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2445.221975] LustreError: 125306:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2445.507538] Lustre: server umount lustre-MDT0001 complete [ 2453.440491] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 17:55:59 (1781819759) [ 2459.295360] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2459.818875] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2463.656892] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2465.262456] LustreError: 129691:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2465.298328] LustreError: 129691:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2470.372829] LustreError: 129692:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2470.740178] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2474.716428] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2480.944746] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2484.968151] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2488.974821] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2492.555962] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2496.635367] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2510.926674] Lustre: *** cfs_fail_loc=159, val=0*** [ 2526.386752] Lustre: lustre-MDT0000: Client b32c8717-54b8-49d0-8599-0eadcb97db60 (at 192.168.202.57@tcp) reconnecting [ 2527.145104] Lustre: *** cfs_fail_loc=159, val=0*** [ 2527.151387] Lustre: Skipped 7 previous similar messages [ 2543.774078] Lustre: lustre-MDT0000: Client b32c8717-54b8-49d0-8599-0eadcb97db60 (at 192.168.202.57@tcp) reconnecting [ 2547.681858] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2547.687084] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2547.697221] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2550.755266] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2551.848270] Lustre: server umount lustre-OST0000 complete [ 2555.873024] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2555.877344] Lustre: Skipped 1 previous similar message [ 2555.879526] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2555.882853] Lustre: Skipped 3 previous similar messages [ 2560.494410] Lustre: server umount lustre-MDT0000 complete [ 2560.993362] LustreError: 129687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2561.004383] LustreError: 129687:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2562.468983] LustreError: 130427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781819869 with bad export cookie 11981939313123293699 [ 2562.471865] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2562.476369] LustreError: 130427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2562.693800] Lustre: server umount lustre-MDT0001 complete [ 2569.596297] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 2571.340500] Key type lgssc unregistered [ 2571.513594] LNet: 133483:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2572.584556] LNet: Removed LNI 192.168.202.157@tcp [ 2573.045486] Key type .llcrypt unregistered [ 2573.047849] Key type ._llcrypt unregistered [ 2586.821442] Key type ._llcrypt registered [ 2586.824673] Key type .llcrypt registered [ 2586.921764] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2587.535044] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2587.551086] alg: No test for adler32 (adler32-zlib) [ 2588.549989] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 2588.729708] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 2590.391903] Key type lgssc registered [ 2591.118989] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2596.022448] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2596.042103] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2597.412223] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2599.827924] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2605.834298] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2606.085170] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2608.850383] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2613.636080] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2616.980152] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2620.275412] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2620.490801] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2622.521695] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2623.580441] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2627.650404] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2639.041469] Lustre: *** cfs_fail_loc=159, val=0*** [ 2655.381540] Lustre: lustre-MDT0000: Client 342da274-edc8-45b0-b305-46b115c52ff1 (at 192.168.202.57@tcp) reconnecting [ 2656.379482] Lustre: *** cfs_fail_loc=159, val=0*** [ 2672.791333] Lustre: lustre-MDT0001: Client 342da274-edc8-45b0-b305-46b115c52ff1 (at 192.168.202.57@tcp) reconnecting [ 2673.463446] Lustre: *** cfs_fail_loc=159, val=0*** [ 2673.465509] Lustre: Skipped 3 previous similar messages [ 2689.678441] Lustre: lustre-MDT0001: Client 342da274-edc8-45b0-b305-46b115c52ff1 (at 192.168.202.57@tcp) reconnecting [ 2704.289375] Lustre: 137936:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2705.342723] Lustre: *** cfs_fail_loc=159, val=0*** [ 2705.344390] Lustre: Skipped 1 previous similar message [ 2721.937689] Lustre: lustre-MDT0000: Client 0aa0e78f-84ad-437c-bdb0-aecc18266db8 (at 192.168.202.57@tcp) reconnecting [ 2722.686616] Lustre: *** cfs_fail_loc=159, val=0*** [ 2722.688836] Lustre: Skipped 14 previous similar messages [ 2738.328031] Lustre: lustre-MDT0000: Client 0aa0e78f-84ad-437c-bdb0-aecc18266db8 (at 192.168.202.57@tcp) reconnecting [ 2739.058086] Lustre: 138227:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2743.269167] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2743.273779] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2743.273864] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2743.283688] Lustre: Skipped 1 previous similar message [ 2743.293088] Lustre: Skipped 1 previous similar message [ 2746.920755] Lustre: server umount lustre-OST0000 complete [ 2749.407852] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2749.410557] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2749.414251] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2753.504104] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2753.507804] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2754.832842] Lustre: server umount lustre-MDT0000 complete [ 2757.093951] LustreError: 134858:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781820064 with bad export cookie 1084403471118200311 [ 2757.096947] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2757.100661] LustreError: 134858:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2757.262179] Lustre: server umount lustre-MDT0001 complete [ 2763.120481] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 2764.553659] Key type lgssc unregistered [ 2764.724348] LNet: 139289:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2765.797878] LNet: Removed LNI 192.168.202.157@tcp [ 2766.173646] Key type .llcrypt unregistered [ 2766.175933] Key type ._llcrypt unregistered [ 2776.783413] Key type ._llcrypt registered [ 2776.784634] Key type .llcrypt registered [ 2776.833280] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2777.287630] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2777.299420] alg: No test for adler32 (adler32-zlib) [ 2778.168419] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 2778.256229] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 2779.855202] Key type lgssc registered [ 2780.404113] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2783.696711] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2783.705709] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2784.895194] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2786.718411] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2791.275386] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2791.494585] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2794.385926] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2799.613650] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2803.056824] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2807.745700] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2807.952821] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2810.029682] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2811.803855] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2815.462841] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2816.171809] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2820.307571] Lustre: 143263:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2821.227671] Lustre: 143312:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2821.929747] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2823.470134] Lustre: 143467:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2823.974379] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2823.978528] Lustre: Skipped 1 previous similar message [ 2824.294886] Lustre: 143565:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2825.696296] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2825.699975] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2825.706109] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2826.720367] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2826.723665] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2826.724294] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2826.733846] Lustre: Skipped 1 previous similar message [ 2831.695043] Lustre: server umount lustre-OST0000 complete [ 2836.960626] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2836.963787] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2836.966867] Lustre: Skipped 1 previous similar message [ 2836.973384] Lustre: Skipped 1 previous similar message [ 2839.798613] Lustre: server umount lustre-MDT0000 complete [ 2842.081852] LustreError: 140676:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2842.100223] LustreError: 140676:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2842.165251] LustreError: 142524:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781820149 with bad export cookie 15852109456440517502 [ 2842.166499] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2842.173833] LustreError: 142524:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2842.404227] Lustre: server umount lustre-MDT0001 complete [ 2849.720047] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 2851.424236] Key type lgssc unregistered [ 2851.614427] LNet: 144621:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2852.649899] LNet: Removed LNI 192.168.202.157@tcp [ 2853.158738] Key type .llcrypt unregistered [ 2853.160808] Key type ._llcrypt unregistered [ 2864.981083] Key type ._llcrypt registered [ 2864.982158] Key type .llcrypt registered [ 2865.025061] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2865.376728] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2865.383897] alg: No test for adler32 (adler32-zlib) [ 2866.256334] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 2866.353462] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 2867.951372] Key type lgssc registered [ 2868.470625] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2872.521993] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2872.536069] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2873.775343] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2875.527230] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2878.984464] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2879.157605] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2880.691345] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2883.738486] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2885.916480] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2888.706129] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2888.883660] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2889.893755] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 2891.100426] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2893.658408] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2899.120467] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 2907.009131] Lustre: *** cfs_fail_loc=159, val=0*** [ 2922.129596] Lustre: lustre-MDT0000: Client dd687610-0c68-4ed1-9162-561211b37dfd (at 192.168.202.57@tcp) reconnecting [ 2925.026028] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2925.026033] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2925.027450] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2925.030811] Lustre: Skipped 1 previous similar message [ 2929.706736] Lustre: server umount lustre-OST0000 complete [ 2935.265687] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2935.266834] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2935.275332] Lustre: Skipped 1 previous similar message [ 2935.277251] Lustre: Skipped 1 previous similar message [ 2937.688420] Lustre: server umount lustre-MDT0000 complete [ 2939.160178] LustreError: 146753:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781820246 with bad export cookie 14520793691549173415 [ 2939.163971] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2939.164622] LustreError: 146753:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2939.280946] Lustre: server umount lustre-MDT0001 complete [ 2944.391439] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 2945.491097] Key type lgssc unregistered [ 2945.620443] LNet: 149698:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2946.661308] LNet: Removed LNI 192.168.202.157@tcp [ 2947.026953] Key type .llcrypt unregistered [ 2947.027979] Key type ._llcrypt unregistered [ 2959.772393] Key type ._llcrypt registered [ 2959.773912] Key type .llcrypt registered [ 2959.836311] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 2960.381703] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2960.449630] alg: No test for adler32 (adler32-zlib) [ 2961.340152] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 2961.457809] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 2963.071181] Key type lgssc registered [ 2963.587962] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2966.924772] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2966.932964] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2968.114338] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2969.736104] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2973.297830] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2973.438986] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2975.086276] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2978.374181] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2981.170503] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2984.531288] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2984.709892] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2986.951549] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 2989.730289] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2992.934146] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2998.057038] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3014.655339] Lustre: lustre-MDT0001: evicting 54338526-f14c-4b8f-a76d-89ed14c01edb (at 192.168.202.57@tcp) by administrative request [ 3014.664868] Lustre: Skipped 1 previous similar message [ 3044.321447] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3044.322854] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3044.327522] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3044.330121] LustreError: Skipped 1 previous similar message [ 3044.333645] Lustre: Skipped 1 previous similar message [ 3045.466721] Lustre: server umount lustre-OST0000 complete [ 3049.440159] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3049.441628] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3049.444790] Lustre: Skipped 2 previous similar messages [ 3053.195480] Lustre: server umount lustre-MDT0000 complete [ 3054.560261] LustreError: 153587:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3054.576590] LustreError: 153587:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3055.878291] LustreError: 151071:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781820363 with bad export cookie 14288904370162430998 [ 3055.881727] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3055.887923] LustreError: 151071:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3056.269921] Lustre: server umount lustre-MDT0001 complete [ 3065.345587] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 3067.138481] Key type lgssc unregistered [ 3067.326215] LNet: 155176:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3068.393475] LNet: Removed LNI 192.168.202.157@tcp [ 3068.782465] Key type .llcrypt unregistered [ 3068.783827] Key type ._llcrypt unregistered [ 3105.413414] Key type ._llcrypt registered [ 3105.414592] Key type .llcrypt registered [ 3105.452561] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 3105.773458] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3105.795423] alg: No test for adler32 (adler32-zlib) [ 3106.689308] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 3106.815074] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 3108.407744] Key type lgssc registered [ 3108.948927] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3112.712720] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3112.728207] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3113.981423] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3115.988470] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3119.769833] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3119.977782] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3122.120446] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3126.451382] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3129.650040] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3133.752681] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3133.955751] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3137.690333] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3139.113885] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3141.847505] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3145.256370] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3153.889242] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 3153.892608] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3153.897380] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3155.424471] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3155.427481] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3155.429632] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3155.439226] Lustre: Skipped 1 previous similar message [ 3156.543343] Lustre: server umount lustre-OST0000 complete [ 3160.546073] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3160.547730] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3160.551371] Lustre: Skipped 1 previous similar message [ 3160.555663] Lustre: Skipped 1 previous similar message [ 3164.373244] Lustre: server umount lustre-MDT0000 complete [ 3165.665175] LustreError: 157635:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3165.686034] LustreError: 157635:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3166.511402] LustreError: 157621:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781820473 with bad export cookie 7101946377224366265 [ 3166.519758] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3166.521424] LustreError: 157621:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3166.718362] Lustre: server umount lustre-MDT0001 complete [ 3175.644970] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 3177.966797] Key type lgssc unregistered [ 3178.226424] LNet: 161179:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3179.301660] LNet: Removed LNI 192.168.202.157@tcp [ 3180.000880] Key type .llcrypt unregistered [ 3180.004849] Key type ._llcrypt unregistered [ 3196.648346] Key type ._llcrypt registered [ 3196.649671] Key type .llcrypt registered [ 3196.713310] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 3197.324929] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3197.374582] alg: No test for adler32 (adler32-zlib) [ 3198.417314] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 3198.700596] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 3200.359307] Key type lgssc registered [ 3201.180841] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3210.409716] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 18:08:37 (1781820517) [ 3220.308411] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 3225.924365] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 3246.020760] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3246.032852] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3247.258765] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3247.278874] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3247.327249] Lustre: lustre-MDT0000: new disk, initializing [ 3247.385305] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3247.397762] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3249.835606] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3256.727103] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3256.824405] Lustre: 165416:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3256.873836] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3256.879044] Lustre: Skipped 1 previous similar message [ 3256.939131] Lustre: lustre-MDT0001: new disk, initializing [ 3257.001599] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3257.026710] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3257.033136] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3259.095882] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3263.743182] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3266.177907] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3269.358393] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3269.479598] Lustre: lustre-OST0000: new disk, initializing [ 3269.481962] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3269.486454] Lustre: 167382:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3269.526655] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3269.576486] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3269.581593] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3269.661909] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3272.192596] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3278.196450] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3284.962390] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3284.962667] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3284.964607] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3284.968628] Lustre: Skipped 1 previous similar message [ 3284.974627] LustreError: Skipped 1 previous similar message [ 3286.136257] Lustre: server umount lustre-OST0000 complete [ 3288.032392] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3288.036539] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3288.046440] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3288.050085] Lustre: Skipped 1 previous similar message [ 3290.036785] Lustre: server umount lustre-MDT0000 complete [ 3290.081878] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3292.580485] LustreError: 168535:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781820600 with bad export cookie 2524531497235876109 [ 3292.582592] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3292.591870] LustreError: 168535:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3292.791929] Lustre: server umount lustre-MDT0001 complete [ 3300.416380] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 3302.012875] Key type lgssc unregistered [ 3302.269664] LNet: 169286:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3303.349331] LNet: Removed LNI 192.168.202.157@tcp [ 3304.090843] Key type .llcrypt unregistered [ 3304.093207] Key type ._llcrypt unregistered [ 3323.917116] Key type ._llcrypt registered [ 3323.919151] Key type .llcrypt registered [ 3324.000781] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 3324.952825] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3324.964316] alg: No test for adler32 (adler32-zlib) [ 3325.930767] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 3326.083014] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 3327.695376] Key type lgssc registered [ 3328.531589] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3334.206884] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3334.232042] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3335.590547] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3338.583806] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3343.726371] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3343.972332] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3346.776553] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3351.422241] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3354.802674] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3358.562274] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3358.779185] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3360.820296] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3362.142575] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 3365.910512] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3374.835151] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3374.847336] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3374.855380] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3374.859460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3374.864710] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3375.317457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3375.782188] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3375.787928] Lustre: Skipped 1 previous similar message [ 3375.798716] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3375.805513] Lustre: Skipped 1 previous similar message [ 3375.808109] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3375.812578] Lustre: Skipped 1 previous similar message [ 3375.815248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3375.819618] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3375.824610] Lustre: Skipped 1 previous similar message [ 3376.353289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3376.825331] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3376.827728] Lustre: Skipped 1 previous similar message [ 3376.837767] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3376.842935] Lustre: Skipped 1 previous similar message [ 3376.845105] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3376.849943] Lustre: Skipped 1 previous similar message [ 3376.852172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3376.857594] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3376.860134] Lustre: Skipped 1 previous similar message [ 3377.341463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3377.940521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3378.444588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3378.944214] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3378.951067] Lustre: Skipped 3 previous similar messages [ 3378.958626] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3378.964622] Lustre: Skipped 3 previous similar messages [ 3378.967678] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3378.971634] Lustre: Skipped 3 previous similar messages [ 3378.973915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3378.980105] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3378.982786] Lustre: Skipped 3 previous similar messages [ 3379.455041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3379.875727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3380.320561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3380.755810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3381.249185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3381.740571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3382.220247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3382.684038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3383.180187] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3383.185678] Lustre: Skipped 8 previous similar messages [ 3383.198950] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3383.206294] Lustre: Skipped 8 previous similar messages [ 3383.208723] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3383.213923] Lustre: Skipped 8 previous similar messages [ 3383.215955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3383.223873] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3383.230134] Lustre: Skipped 8 previous similar messages [ 3383.700989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3384.152770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3384.648457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3385.083407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3385.470215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3385.878957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3386.270858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3386.683956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3387.135186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3387.610868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3388.023315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3388.553770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3389.046723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3389.458915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3389.913531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3390.363500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3390.910052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3391.377040] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3391.380016] Lustre: Skipped 17 previous similar messages [ 3391.387592] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3391.392137] Lustre: Skipped 17 previous similar messages [ 3391.394594] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3391.399402] Lustre: Skipped 17 previous similar messages [ 3391.402849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3391.408985] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3391.411465] Lustre: Skipped 17 previous similar messages [ 3391.871351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3392.290959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3392.709876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3393.200049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3393.703149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3394.251653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3394.667837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3395.090035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3395.638903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3396.223740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3396.766248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3397.295295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3397.889825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3398.458922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3399.059827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3399.572845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3399.993535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3400.406304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3400.831131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3401.279811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3401.875523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3402.366463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3402.837303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3403.313211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3403.899295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3404.400505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3404.881620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.337599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.730480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3406.166972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3406.598222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.015587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.459740] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3407.463922] Lustre: Skipped 32 previous similar messages [ 3407.475501] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3407.483973] Lustre: Skipped 32 previous similar messages [ 3407.486574] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3407.493636] Lustre: Skipped 32 previous similar messages [ 3407.496588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.511671] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3407.521800] Lustre: Skipped 32 previous similar messages [ 3407.955364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.334996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.682203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3409.079672] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3409.084114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3409.084190] LustreError: 170720:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3409.486885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3409.898930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.303294] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3410.308439] LustreError: 170720:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3410.312335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.723952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3411.193146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3411.642750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.209518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.855722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3413.439878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3414.059311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3414.536520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.128727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.739611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3416.374317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3416.989111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3417.531870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3418.023664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3418.611434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.190894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.721614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.282298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.787325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.233383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.767413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.257609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.743353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.150281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.687866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.191733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.789838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3425.240176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3425.767889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.285868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.786624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3427.285789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3427.833700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.282374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.770897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.257525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.661285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.075245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.504127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.910719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.359929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.791953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.281820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.761631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.312087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.868535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3434.452768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.068625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.608366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.087667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.547711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.965958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.384059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.845963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.277748] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3438.281933] LustreError: 170720:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3438.284066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.619251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.956594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.327072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.691963] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3439.694931] Lustre: Skipped 65 previous similar messages [ 3439.701434] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3439.706922] Lustre: Skipped 65 previous similar messages [ 3439.708635] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3439.711964] Lustre: Skipped 65 previous similar messages [ 3439.714050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.718616] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3439.727954] Lustre: Skipped 65 previous similar messages [ 3440.073356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.457972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.852316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.217990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.714909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.165874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.574822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.999291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.367704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.775900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3444.294797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3444.675529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.049910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.410450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.775726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.166878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.615168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.140474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.674305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.149649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.574069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.044346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.431341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.892945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.354039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.845078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.285993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.647562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.117183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.694122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.254758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.668076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.191298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.739394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.212756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.748264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.231951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.842665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3457.339473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3457.760792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.265963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.848404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.300051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.785747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.403408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.921927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.500489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.059721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.552108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.117874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.697591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.219448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.786244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.408262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.915555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.426629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.947286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.426749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.959635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.518263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.998278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.477269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.963277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.452031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.976147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.529101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.069032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.558923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.198775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.756718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.302161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.811407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.341792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.870138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.313820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.865598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.382383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.912896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.404395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.993172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.613978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.208191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.783540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.381266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.904085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.453386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.996332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.625261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.162750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.680914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.154114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.737292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.271692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.744207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.285694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.796160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.309964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.831614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.350497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.864529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.343803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.835393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.303849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.841620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.529832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.140557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.669649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.121950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.596964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.039464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.436698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.864640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.289929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.727404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.156269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.676606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.148720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.735025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.246173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.680783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.172486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.599562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.070884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.495125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.949430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.422050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.914744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.376181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.880124] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3503.887036] Lustre: Skipped 128 previous similar messages [ 3503.896715] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3503.902783] Lustre: Skipped 128 previous similar messages [ 3503.905819] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3503.910533] Lustre: Skipped 128 previous similar messages [ 3503.913582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.920296] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3503.926831] Lustre: Skipped 128 previous similar messages [ 3504.511433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.995602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.483464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.059692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.577182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.076576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.583359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.044921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.516951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.086510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.601353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.161718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.691369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.235602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.661265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.094094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.569523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.049335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.506468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.934271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.359336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.848184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.313038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.725949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.116490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.551930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.957845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.345184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.731959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.089222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.502437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.944121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.323705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.720172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.121216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.468247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.918675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.353837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.836818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.276657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.763144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.259809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.727944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.265729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.758280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.291862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.777545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.207313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.634514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.066596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.493733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.934830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.354927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.801105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.279584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.707839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.196299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.681211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.231732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.677296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.120217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.513627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.870714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.275253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.665786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.054120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.444265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.872576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.250160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.717384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.134788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.562238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.977858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.369242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.762074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.163450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.515511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.869184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.211640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.576686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.934157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.287393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.640767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.007184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.378107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.742049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.130491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.499761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.899316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.244347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.594498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.932922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.303623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.674922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.054773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.470404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.864506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.229922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.612250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.034024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.449384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.823471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.247241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.726096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.167221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.592053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.090643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.674915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.335316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.973261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.673384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.442328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.163611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.840156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.502666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.041561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.557384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.099177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.656096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.318779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.025994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.621384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.099586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.663722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.360057] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3561.364080] LustreError: 170720:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3561.368185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.939022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.780224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.607513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.318917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.877344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.467769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.954829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.417229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.197061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.896148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.478172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.951733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.477176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.990194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.460851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.857806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.353522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.745233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.129585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.500864] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3572.505435] LustreError: 170720:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3572.506252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.918018] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.390559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.870622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.327398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.738288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.210619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.616480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.031578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.496155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.923969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.294184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.672890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.085905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.544330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.032648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.461412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.892212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.276925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.686617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.111841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.528919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.905585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.269336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.662059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.020880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.398759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.797628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.247248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.617389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.080128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.453894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.871223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.344918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.745349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.116377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.532034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.913976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.280517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.657832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.039524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.387917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.738000] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.118136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.449591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.776599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.127531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.470951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.830539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.189258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.573100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.945985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.348913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.732279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.102292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.527779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.865942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.223299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.576603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.948961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.317971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.707245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.115963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.480553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.867418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.256920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.635285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.032058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.408437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.790729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.160876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.550888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.036780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.413343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.770399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.124815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.494656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.860936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.234312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.617672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.024259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.457693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.876691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.280837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.678842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.068719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.454929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.901979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.334684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.815809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.227808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.648964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.069502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.492784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.898230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.310350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.717178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.155782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.624668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.044802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.524037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.903797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.341742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.727878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.087774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.492636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.884918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.297075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.749873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.192300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.687143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.105519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.566929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.051683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.456329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.867210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.426475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.876619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.305716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.710926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.132747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.505307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.894032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.284599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.694719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.042642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.396966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.777404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.139058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.552935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.945083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.333173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.792864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.166689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.574050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.971273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.371257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.806300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.228104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.640282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.002820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.385817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.768113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.197694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.632611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.012312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.374427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.735847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.130176] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3632.132632] Lustre: Skipped 292 previous similar messages [ 3632.141527] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3632.146635] Lustre: Skipped 292 previous similar messages [ 3632.148456] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3632.150974] Lustre: Skipped 292 previous similar messages [ 3632.152966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.158424] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3632.160873] Lustre: Skipped 292 previous similar messages [ 3632.579744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.002117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.425874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.856718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.280397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.708790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.158526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.597421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.030399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.488418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.986279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.381101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.781297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.189000] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.573808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.953679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.405355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.893549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.406380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.908958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.404147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.954787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.486198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.988033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.448724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.874606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.317437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.783677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.257361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.757991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.289711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.735050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.211069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.714742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.151341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.646075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.120506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.558306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.983613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.417452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.873777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.330630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.773402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.199307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.641345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.205268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.671206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.144677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.668427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.108391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.583754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.076562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.545493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.005222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.476180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.925477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.393450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.855988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.338386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.776281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.232370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.648503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.120708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.601747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.101638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.537927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.984236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.399249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.873562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.326839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.854857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.355556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.799750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.360226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.874900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.235899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.614070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.998304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.344582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.760284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.148864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.537061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.943061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.379500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.781348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.151682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.576189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.005525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.385355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.821044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.289915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.768611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.212896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.736551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.172230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.654526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.090419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.533949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.058362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.718372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.279514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.760504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.380962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.030562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.598350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.155684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.706327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.204079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.668707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.225259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.699365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.161280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.687238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.329764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.721421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.096657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.530219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.004097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.436591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.025301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.742971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.481509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.211520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.851372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.461957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.019366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.510379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.924767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.334947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.790536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.234239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.756115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.291977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.805751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.251483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.724283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.240264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.692429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.179843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.733022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.235410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.744482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.213244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.694285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.134533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.587759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.088309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.552547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.032110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.575380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.054754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.509128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.022502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.506171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.977087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.406126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.818223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.248238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.716676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.135683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.568695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.005641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.431588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.895261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.422415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.898781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.356759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.839312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.262522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.692653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.097227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.547425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.955049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.365652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.725932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.148505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.574822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.034137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.472704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.888932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.291678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.678226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.070399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.494414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.877510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.376323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.787851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.187367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.575209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.974136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.388167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.747436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.141380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.528735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.912427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.324489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.783575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.195079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.581956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.021912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.480944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.890750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.297064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.766826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.291409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.656808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.055070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.434739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.786504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.148470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.577369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.971799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.368114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.792127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.276792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.662747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.060428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.454984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.866134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.213858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.606624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.056450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.453334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.895955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.374460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.761348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.136442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.518349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.887581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.280086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.740680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.118395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.520024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.067306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.489221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.880322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.267855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.621743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.989688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.376704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.750168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.141494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.541645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.951294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.300800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.661829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.018649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.362978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.749489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.077278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.434308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.794971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.147455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.510692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.859511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.240680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.584877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.949347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.313969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.658137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.071709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.462430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.986587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.531627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.114281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.948311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.874872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.690099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.351655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.040641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.660428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.196436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.745832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.300650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.789422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.321255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.811778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.364214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.935374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.465081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.972926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.529089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.101587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.732371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.261753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.782821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.425302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.015621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.585472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.163739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.777311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.404056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.065735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.668454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.270240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.842347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.359549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.817769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.332515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.868678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3772.394919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3772.888775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3773.347232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3773.868888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3774.311673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3774.770494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3775.268850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3775.673653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3776.087770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3776.573581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.001845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.436466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.873879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3778.279753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3778.683326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3779.157876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3779.663419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3780.094689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3780.509246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3780.918899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.364425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.839628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3782.265646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3782.700356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3783.161418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3783.628444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.076341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.475571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.889726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.309831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.757909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.145862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.551490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.975810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.323430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.737121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.099817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.470537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.855755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.251232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.620145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.069197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.435786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.788424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3791.173563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3791.598653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3792.017387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3792.479781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.035487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.581292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3794.109587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3794.577528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.086846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.558647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.970675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.364920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.756740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.118954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.504338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.943693] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3797.949931] LustreError: 170720:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3797.956767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.333524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.697719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3799.077541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3799.478797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3799.893495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3800.270386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3800.640919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.030530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.501367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.900753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3802.306249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3802.770391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3803.253289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3803.660761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.095017] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.509589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.908071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.304585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.695957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.083060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.536116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.932503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3807.324851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3807.724147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.143975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.586706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.050116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.473907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.941442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.428010] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.918368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3811.356252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3811.825385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.244787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.630728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.073567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.490822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.949136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.491433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.913614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.355421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.836594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.306864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.799777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.318298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.739916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.218826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.739746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.272933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.787585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.235494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.671027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.189929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.657696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.083457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.530402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.966982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.477868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.964716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.367978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.778845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.172503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.661318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.093743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.516393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.905641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.325850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.751517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.230199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.724938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.195714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.607007] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.052456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.519706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.036350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.537925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.083724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.517969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.976576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.493589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.968992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.472590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.026419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4130.110811] LustreError: 172522:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4130.119161] LustreError: 170720:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 4349.926437] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 4349.930937] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4349.936891] Lustre: Skipped 443 previous similar messages [ 4349.939305] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4351.968307] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4351.975135] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4351.975139] Lustre: Skipped 1 previous similar message [ 4351.978083] LustreError: Skipped 1 previous similar message [ 4353.166275] Lustre: server umount lustre-OST0000 complete [ 4357.091349] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4357.098780] Lustre: Skipped 1 previous similar message [ 4362.210100] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4362.213523] Lustre: Skipped 1 previous similar message [ 4367.328552] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4367.331869] Lustre: Skipped 1 previous similar message [ 4369.375245] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4369.575135] Lustre: server umount lustre-MDT0000 complete [ 4371.439145] LustreError: 171434:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781821678 with bad export cookie 15664601805123879072 [ 4371.441032] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4371.445777] LustreError: 171434:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4371.608642] Lustre: server umount lustre-MDT0001 complete [ 4377.460161] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 4378.903383] Key type lgssc unregistered [ 4379.067683] LNet: 225795:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4380.133357] LNet: Removed LNI 192.168.202.157@tcp [ 4380.550518] Key type .llcrypt unregistered [ 4380.552965] Key type ._llcrypt unregistered [ 4392.960928] Key type ._llcrypt registered [ 4392.962492] Key type .llcrypt registered [ 4393.027403] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 4393.377918] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4393.411372] alg: No test for adler32 (adler32-zlib) [ 4394.324984] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 4394.451109] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 4396.055198] Key type lgssc registered [ 4396.699273] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4400.701019] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4400.718803] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4401.970888] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4403.965699] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4408.575149] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4408.776865] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4410.690248] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4414.141875] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4416.872486] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4420.453417] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4420.648552] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4423.474142] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4426.802024] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 4427.011604] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4435.244224] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4436.290992] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4436.296656] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4436.300035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.306058] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4436.307933] LustreError: 227208:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 4439.012532] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4439.013181] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4439.023205] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4439.038193] Lustre: Skipped 1 previous similar message [ 4439.696877] Lustre: lustre-OST0000: Not available for connect from 192.168.202.57@tcp (stopping) [ 4443.826839] Lustre: server umount lustre-OST0000 complete [ 4456.319136] LustreError: 227208:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 4473.776191] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4474.016196] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4477.187111] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4479.144658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.161955] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.164825] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4479.170074] Lustre: Skipped 1 previous similar message [ 4480.794512] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4481.816692] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 4485.249963] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8f4946fa7000.ost_server_uuid 50 [ 4486.225946] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8f4946fa7000.ost_server_uuid in FULL state after 0 sec [ 4489.696342] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4489.700554] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4489.702752] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4489.707527] Lustre: Skipped 2 previous similar messages [ 4494.634637] Lustre: server umount lustre-OST0000 complete [ 4499.936739] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4499.938243] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4499.947389] Lustre: Skipped 1 previous similar message [ 4499.953478] Lustre: Skipped 1 previous similar message [ 4505.056572] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4505.068205] Lustre: Skipped 1 previous similar message [ 4511.199139] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4511.298539] Lustre: server umount lustre-MDT0000 complete [ 4513.586390] LustreError: 227169:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781821821 with bad export cookie 1520696381275038812 [ 4513.588603] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4513.599883] LustreError: 227169:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4513.830331] Lustre: server umount lustre-MDT0001 complete [ 4521.529408] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 4523.157594] Key type lgssc unregistered [ 4523.356655] LNet: 232391:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4524.392924] LNet: Removed LNI 192.168.202.157@tcp [ 4524.892115] Key type .llcrypt unregistered [ 4524.894199] Key type ._llcrypt unregistered [ 4543.892515] Key type ._llcrypt registered [ 4543.893880] Key type .llcrypt registered [ 4543.956734] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 4544.468458] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4544.483129] alg: No test for adler32 (adler32-zlib) [ 4545.428819] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 4545.584570] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 4547.216928] Key type lgssc registered [ 4547.841439] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4553.815263] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4553.830557] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4555.150795] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4557.553786] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4562.526165] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4562.772679] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4565.308285] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4567.616313] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4572.051451] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4572.346172] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4576.585159] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4580.531268] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 4582.727172] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4582.835110] Lustre: lustre-OST0001: new disk, initializing [ 4582.837382] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4582.840867] Lustre: 236420:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4582.900208] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4585.942107] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4585.949150] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4586.027911] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4587.343210] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4595.409982] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4600.998628] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 4611.554805] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4611.559445] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4611.566198] Lustre: Skipped 3 previous similar messages [ 4611.580454] Lustre: Skipped 3 previous similar messages [ 4613.085061] Lustre: server umount lustre-MDT0000 complete [ 4615.452188] LustreError: 235620:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781821922 with bad export cookie 7375319130970797114 [ 4615.458031] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4615.466378] LustreError: 235620:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4616.673069] LustreError: 234110:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4616.673582] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4616.677299] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4616.682244] LustreError: 234110:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4616.700896] Lustre: Skipped 1 previous similar message [ 4617.738589] Lustre: server umount lustre-MDT0001 complete [ 4622.257283] Lustre: server umount lustre-OST0000 complete [ 4624.347223] Lustre: server umount lustre-OST0001 complete [ 4634.345286] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 4639.556633] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4639.889659] LustreError: 239519:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4639.964206] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4642.427949] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4645.347848] LustreError: 239520:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4647.131521] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4649.487838] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4651.025081] Lustre: 240659:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4654.908719] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4655.172805] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4655.178786] Lustre: Skipped 1 previous similar message [ 4657.191135] LustreError: 241013:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4658.340379] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4662.244217] LustreError: 241013:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4663.094193] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4665.273674] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49760) [ 4665.278057] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 4666.504775] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4671.304744] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4673.392507] Lustre: 242528:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4680.675941] Lustre: mylustre-MDT0000-lwp-OST0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4680.681294] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4680.687074] Lustre: Skipped 3 previous similar messages [ 4680.693780] Lustre: Skipped 4 previous similar messages [ 4681.453310] Lustre: server umount mylustre-MDT0000 complete [ 4683.747915] LustreError: 242728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781821991 with bad export cookie 7375319130970799921 [ 4683.754522] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4683.757106] LustreError: 242728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4683.929900] Lustre: server umount mylustre-MDT0001 complete [ 4696.481288] Lustre: server umount mylustre-OST0000 complete [ 4708.875975] Lustre: server umount mylustre-OST0001 complete [ 4721.927461] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 4727.920756] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4728.171908] LustreError: 244836:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4728.245758] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4728.252932] Lustre: Skipped 1 previous similar message [ 4730.615693] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4735.648098] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4738.177373] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4739.821863] Lustre: 245978:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4743.363778] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4745.582203] LustreError: 246333:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4745.594496] LustreError: 246333:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4746.449316] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4750.528703] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4752.762683] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 4752.764434] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49792) [ 4754.059600] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4759.172679] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4761.396517] Lustre: 247846:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4766.690316] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4766.699211] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4766.712982] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 4771.685644] Lustre: server umount tfs-MDT0000 complete [ 4773.994803] LustreError: 244812:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822081 with bad export cookie 7375319130970801804 [ 4774.000351] LustreError: 244812:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4774.001776] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4774.207750] Lustre: server umount tfs-MDT0001 complete [ 4786.734250] Lustre: server umount tfs-OST0000 complete [ 4799.038723] Lustre: server umount tfs-OST0001 complete [ 4810.647411] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 4815.973233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4816.204789] LustreError: 250095:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4816.224158] LustreError: 250095:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 4816.294185] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4816.299744] Lustre: Skipped 3 previous similar messages [ 4818.312691] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4822.658042] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4824.918407] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4826.485326] Lustre: 251237:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4829.839418] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4833.286676] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4837.874415] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4841.132749] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49824) [ 4841.141907] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 4841.365946] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4845.948087] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4848.002729] Lustre: 253105:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4851.653133] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 18:35:58 (1781822158) [ 4867.042194] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4867.051944] Lustre: Skipped 5 previous similar messages [ 4867.053317] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4867.062607] Lustre: Skipped 7 previous similar messages [ 4870.893965] Lustre: server umount lustre-MDT0000 complete [ 4872.753024] LustreError: 250070:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822180 with bad export cookie 7375319130970803477 [ 4872.754435] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4872.764204] LustreError: 250070:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4877.283940] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4877.287439] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4877.291345] Lustre: Skipped 1 previous similar message [ 4877.297462] Lustre: Skipped 1 previous similar message [ 4879.084383] Lustre: server umount lustre-MDT0001 complete [ 4887.621802] Lustre: server umount lustre-OST0000 complete [ 4896.104772] Lustre: server umount lustre-OST0001 complete [ 4900.998236] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 4907.863373] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 4930.907135] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 4930.907135] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 4930.907135] [ 4930.928619] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 4931.098716] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4931.119187] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4931.173286] Lustre: lustre-MDT0000: new disk, initializing [ 4931.236345] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4931.240737] Lustre: Skipped 3 previous similar messages [ 4931.256230] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4934.015744] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4940.829529] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 4940.829529] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 4940.829529] [ 4940.851067] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 4940.931683] Lustre: 256285:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4940.980464] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4940.983152] Lustre: Skipped 1 previous similar message [ 4941.056416] Lustre: lustre-MDT0001: new disk, initializing [ 4941.177623] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4941.184739] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4943.439624] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4949.502297] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4949.725914] Lustre: lustre-OST0000: new disk, initializing [ 4949.728812] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4949.733067] Lustre: 257865:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4950.982345] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4950.990987] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4951.065099] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4953.622915] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4960.495688] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4960.643804] Lustre: lustre-OST0001: new disk, initializing [ 4960.646624] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4960.651477] Lustre: 258735:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4962.011756] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4962.019881] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4962.116075] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4964.516043] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 4972.443992] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 18:37:59 (1781822279) [ 4980.627269] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 18:38:07 (1781822287) [ 4997.088187] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4997.091910] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4997.100494] LustreError: Skipped 1 previous similar message [ 4997.105943] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4997.112987] Lustre: Skipped 1 previous similar message [ 5007.327605] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5007.373982] Lustre: server umount lustre-OST0000 complete [ 5008.358110] LustreError: 258863:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5008.378108] LustreError: 258863:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 5012.961464] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5024.223266] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5024.341142] Lustre: server umount lustre-MDT0000 complete [ 5026.429635] LustreError: 256276:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822333 with bad export cookie 7375319130970805031 [ 5026.430871] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5026.439378] LustreError: 256276:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5031.840652] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5031.842476] Lustre: Skipped 15 previous similar messages [ 5032.658366] Lustre: server umount lustre-MDT0001 complete [ 5039.387706] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 5051.107067] Lustre: server umount lustre-OST0001 complete [ 5056.475514] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 5066.595226] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 5088.540608] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5088.716966] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5088.739521] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5088.790771] Lustre: lustre-MDT0000: new disk, initializing [ 5088.847465] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5088.856238] Lustre: Skipped 3 previous similar messages [ 5088.869476] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5091.657308] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5100.250406] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5100.318948] Lustre: 263268:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5100.507502] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5103.851760] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5110.977232] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5115.622792] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5121.146335] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5121.326380] Lustre: lustre-OST0000: new disk, initializing [ 5121.328757] Lustre: Skipped 1 previous similar message [ 5121.332536] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5121.335300] Lustre: Skipped 2 previous similar messages [ 5121.338318] Lustre: 265235:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5122.640302] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5122.650574] Lustre: Skipped 1 previous similar message [ 5122.662197] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5122.778176] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5125.763287] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5132.008445] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5138.406589] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5138.413337] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5138.424426] LustreError: Skipped 1 previous similar message [ 5138.441258] Lustre: Skipped 5 previous similar messages [ 5138.445120] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5142.332354] Lustre: server umount lustre-OST0000 complete [ 5146.593129] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5159.391250] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5159.583462] Lustre: server umount lustre-MDT0000 complete [ 5162.465595] LustreError: 263258:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822469 with bad export cookie 7375319130970806494 [ 5162.469773] LustreError: 263258:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5162.469800] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5162.625263] Lustre: server umount lustre-MDT0001 complete [ 5172.516545] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 5174.431628] Key type lgssc unregistered [ 5174.651826] LNet: 266994:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5175.717965] LNet: Removed LNI 192.168.202.157@tcp [ 5176.265518] Key type .llcrypt unregistered [ 5176.268379] Key type ._llcrypt unregistered [ 5189.290703] Key type ._llcrypt registered [ 5189.291893] Key type .llcrypt registered [ 5189.330105] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 5189.669422] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5189.676865] alg: No test for adler32 (adler32-zlib) [ 5190.599285] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 5190.725863] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 5192.343187] Key type lgssc registered [ 5192.828575] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5196.159071] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5196.166515] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5197.381226] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5199.598600] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5204.499391] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5204.785717] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5207.026812] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5210.381815] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5212.749585] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5215.827980] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5216.030220] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5219.066538] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5222.185459] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5223.180810] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5223.782572] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 5227.495017] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5227.500163] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5227.511238] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5229.541384] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5231.299349] Lustre: server umount lustre-OST0000 complete [ 5234.660182] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5234.668880] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5234.674584] Lustre: Skipped 2 previous similar messages [ 5239.776254] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5239.779748] Lustre: Skipped 1 previous similar message [ 5240.241481] Lustre: server umount lustre-MDT0000 complete [ 5241.857472] LustreError: 268416:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822549 with bad export cookie 2117563870698045650 [ 5241.859312] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5241.862387] LustreError: 268416:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5241.995466] Lustre: server umount lustre-MDT0001 complete [ 5246.432237] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 5247.560631] Key type lgssc unregistered [ 5247.696913] LNet: 272012:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5248.741339] LNet: Removed LNI 192.168.202.157@tcp [ 5249.076973] Key type .llcrypt unregistered [ 5249.078203] Key type ._llcrypt unregistered [ 5257.091324] Key type ._llcrypt registered [ 5257.092740] Key type .llcrypt registered [ 5257.158759] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 5257.720964] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5257.787537] alg: No test for adler32 (adler32-zlib) [ 5258.741113] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 5258.897350] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 5260.583255] Key type lgssc registered [ 5261.144587] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5268.583183] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5268.594505] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5284.127251] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 5289.247799] LustreError: 273184:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.157@tcp: failed processing log, type 4: rc = -110 [ 5315.999453] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5317.946580] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5320.459533] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5321.454605] Lustre: server umount lustre-OST0000 complete [ 5328.652852] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 5329.730759] Key type lgssc unregistered [ 5329.871800] LNet: 274814:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5330.921362] LNet: Removed LNI 192.168.202.157@tcp [ 5331.220588] Key type .llcrypt unregistered [ 5331.221558] Key type ._llcrypt unregistered [ 5350.991711] Key type ._llcrypt registered [ 5350.992818] Key type .llcrypt registered [ 5351.032277] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 5351.403390] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5351.413459] alg: No test for adler32 (adler32-zlib) [ 5352.297547] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 5352.390267] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 5353.976124] Key type lgssc registered [ 5354.397818] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5358.837407] loop0: detected capacity change from 0 to 204800000 [ 5358.895701] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5358.899363] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5359.011068] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5359.364767] loop0: detected capacity change from 0 to 204800000 [ 5359.429929] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5359.433399] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5359.562436] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5359.945078] loop0: detected capacity change from 0 to 204800000 [ 5360.000886] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5360.003678] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5360.043673] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5360.401840] loop0: detected capacity change from 0 to 204800000 [ 5360.459284] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5360.855553] loop0: detected capacity change from 0 to 204800000 [ 5360.869784] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5362.355057] loop0: detected capacity change from 0 to 204800000 [ 5362.366982] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5364.045181] loop0: detected capacity change from 0 to 204800000 [ 5364.052204] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5371.448880] loop0: detected capacity change from 0 to 204800000 [ 5371.460479] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5375.160392] loop0: detected capacity change from 0 to 204800000 [ 5375.191440] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5375.203634] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5375.237276] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5375.239934] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 5375.242533] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 5375.246031] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 5375.249847] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 5375.252580] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 5375.255666] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 5375.259365] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 5375.263142] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 5375.266372] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 5375.270447] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 5375.273839] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 5375.277534] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 5375.280645] Lustre: 278203:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 5377.769735] Lustre: server umount MGS complete [ 5378.052238] loop0: detected capacity change from 0 to 204800000 [ 5378.079673] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5378.233477] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5378.246431] Lustre: lustre-MDT0000: Aborting client recovery [ 5378.545223] loop1: detected capacity change from 0 to 204800000 [ 5378.571529] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5378.608171] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5378.612303] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 5378.615230] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 5378.618754] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 5378.621271] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 5378.624341] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 5378.629198] Lustre: 278633:0:(osd_scrub.c:1830:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 5378.636960] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5379.031821] loop2: detected capacity change from 0 to 204800000 [ 5379.063310] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5379.099644] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5379.102727] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 5379.105431] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 5379.108141] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 5379.110877] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 5379.113722] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 5379.116780] Lustre: 278715:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 5379.169548] Lustre: Found index 0 for lustre-OST0000, updating log [ 5379.183173] Lustre: 278733:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5379.202875] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5379.204085] Lustre: Skipped 1 previous similar message [ 5379.209560] Lustre: lustre-OST0000: Aborting recovery [ 5379.497689] loop3: detected capacity change from 0 to 204800000 [ 5379.540688] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5379.580967] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5379.583985] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 5379.586497] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 5379.589249] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 5379.592947] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 5379.595718] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 5379.598467] Lustre: 278798:0:(osd_scrub.c:1830:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 5387.810145] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 5387.816442] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 5387.819312] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 5387.821348] LustreError: 278577:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 5387.825609] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 5388.835712] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 5388.838823] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 5389.935160] LustreError: 278544:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 315us: rc = -2 [ 5404.129884] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5404.130334] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5404.133137] Lustre: Skipped 3 previous similar messages [ 5404.134899] Lustre: Skipped 2 previous similar messages [ 5407.398863] Lustre: server umount lustre-MDT0000 complete [ 5407.748046] LustreError: 278529:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822715 with bad export cookie 5537504516011019713 [ 5407.749401] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5407.751165] LustreError: 278529:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5409.247602] LustreError: 278543:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5409.247911] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5409.248125] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5409.248130] Lustre: Skipped 1 previous similar message [ 5409.251491] LustreError: 278543:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5409.254351] Lustre: Skipped 1 previous similar message [ 5412.255645] LustreError: 278541:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5412.255758] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5412.260580] LustreError: 278541:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5412.262519] Lustre: Skipped 2 previous similar messages [ 5414.004080] Lustre: server umount lustre-MDT0001 complete [ 5420.427973] Lustre: server umount lustre-OST0000 complete [ 5435.359170] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5435.452657] Lustre: server umount lustre-OST0001 complete [ 5440.538583] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 18:45:46 (1781822746) [ 5471.211379] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 5481.417359] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 5510.483639] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5510.654797] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5510.680792] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5510.740907] Lustre: lustre-MDT0000: new disk, initializing [ 5510.810635] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5510.818253] Lustre: Skipped 1 previous similar message [ 5510.829717] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5513.516775] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5520.966539] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5521.043870] Lustre: 282874:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5521.078812] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5521.081334] Lustre: Skipped 1 previous similar message [ 5521.123208] Lustre: lustre-MDT0001: new disk, initializing [ 5521.183448] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5521.209725] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5521.222552] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5524.428908] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5531.078348] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5534.755938] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5539.264343] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5539.478574] Lustre: lustre-OST0000: new disk, initializing [ 5539.483355] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5539.493066] Lustre: 284839:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5539.502901] Lustre: 284839:0:(osd_compat.c:1352:osd_object_spec_find()) Skipped 1 previous similar message [ 5539.577337] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5544.154554] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5546.535875] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5546.547030] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5546.659891] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5551.029372] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5555.336352] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 5564.497493] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 5571.021367] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 5578.255478] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 5618.660520] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5618.663712] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5618.666202] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5618.672571] Lustre: Skipped 1 previous similar message [ 5623.787647] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5623.793825] Lustre: Skipped 1 previous similar message [ 5628.383094] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5628.518580] Lustre: server umount lustre-OST0000 complete [ 5634.017179] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5634.017506] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5634.018765] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5634.022822] LustreError: Skipped 1 previous similar message [ 5634.029606] Lustre: Skipped 1 previous similar message [ 5637.476611] LustreError: 286970:0:(ldlm_resource.c:1180:ldlm_resource_complain()) MGS: namespace resource [0x65727473756c:0x5:0x0].0x0 (00000000e2b70642) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 5637.524483] Lustre: server umount lustre-MDT0000 complete [ 5639.135772] LustreError: 284242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5639.141794] LustreError: 284242:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5640.268957] LustreError: 282867:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781822947 with bad export cookie 5537504516011022422 [ 5640.270341] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5640.273410] LustreError: 282867:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 5640.399309] Lustre: server umount lustre-MDT0001 complete [ 5647.523265] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5651.531098] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5655.908468] Lustre: server umount MGS complete [ 5664.350521] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5664.655938] LustreError: 288752:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5664.671946] LustreError: 288765:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5664.716231] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5667.509295] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5669.857976] LustreError: 288753:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5673.475327] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5677.233763] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5682.678481] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5687.042770] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5692.294307] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5692.617445] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5692.630197] Lustre: Skipped 1 previous similar message [ 5698.044323] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5703.721505] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5745.120389] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5745.129827] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5745.142976] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5745.146634] Lustre: Skipped 1 previous similar message [ 5748.686515] Lustre: server umount lustre-OST0000 complete [ 5755.873478] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5755.878022] LustreError: Skipped 1 previous similar message [ 5755.880339] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5755.888606] Lustre: Skipped 1 previous similar message [ 5757.946922] Lustre: server umount lustre-MDT0000 complete [ 5760.997372] LustreError: 289486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781823068 with bad export cookie 5537504516011024249 [ 5761.001939] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5761.006066] LustreError: 289486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5761.250637] Lustre: server umount lustre-MDT0001 complete [ 5769.231637] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 5771.064345] Key type lgssc unregistered [ 5771.250156] LNet: 292717:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5772.326529] LNet: Removed LNI 192.168.202.157@tcp [ 5772.814203] Key type .llcrypt unregistered [ 5772.816735] Key type ._llcrypt unregistered [ 5800.358287] Key type ._llcrypt registered [ 5800.360264] Key type .llcrypt registered [ 5800.429489] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 5810.941155] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 5811.711159] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5811.745195] alg: No test for adler32 (adler32-zlib) [ 5812.710293] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 5812.873751] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 5814.511174] Key type lgssc registered [ 5815.449565] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5842.335443] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5842.349849] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5843.514118] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5843.536172] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5843.586089] Lustre: lustre-MDT0000: new disk, initializing [ 5843.642271] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5843.654795] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5846.067565] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5854.175561] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5854.250263] Lustre: 296650:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5854.291502] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5854.295238] Lustre: Skipped 1 previous similar message [ 5854.347979] Lustre: lustre-MDT0001: new disk, initializing [ 5854.410054] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5854.439442] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5854.455490] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5858.535528] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5865.859055] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5869.894767] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5874.356394] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5874.570211] Lustre: lustre-OST0000: new disk, initializing [ 5874.572372] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5874.575441] Lustre: 298618:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5874.624032] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5878.651086] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5882.415717] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5882.424266] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5882.486214] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5885.413442] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5891.169242] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 5902.311160] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 5907.911780] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 5948.901884] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5948.914754] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5948.919261] Lustre: Skipped 1 previous similar message [ 5954.020810] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5954.027453] Lustre: Skipped 1 previous similar message [ 5954.820780] Lustre: server umount lustre-OST0000 complete [ 5959.139050] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5959.140752] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5959.149405] Lustre: Skipped 2 previous similar messages [ 5959.158293] Lustre: Skipped 1 previous similar message [ 5963.473413] Lustre: server umount lustre-MDT0000 complete [ 5966.343151] LustreError: 299473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781823273 with bad export cookie 17111068468211378808 [ 5966.345397] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5966.353711] LustreError: 299473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5966.605556] Lustre: server umount lustre-MDT0001 complete [ 5972.356210] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5976.019259] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5981.058308] Lustre: server umount MGS complete [ 5992.318990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5992.789707] LustreError: 302529:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5992.805712] LustreError: 302529:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5992.833101] LustreError: 302542:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5992.921542] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5997.046373] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 5998.049271] LustreError: 302530:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6003.171168] LustreError: 302529:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6004.103017] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6004.376083] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6007.460646] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 6013.519890] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6017.268589] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6022.111876] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6022.321115] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6027.573703] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 6033.092439] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6068.707626] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6068.709590] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6068.724703] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6068.746168] Lustre: Skipped 1 previous similar message [ 6073.825613] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6073.833658] Lustre: Skipped 2 previous similar messages [ 6074.025574] Lustre: server umount lustre-OST0000 complete [ 6078.945305] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6078.956274] Lustre: Skipped 1 previous similar message [ 6082.898459] Lustre: server umount lustre-MDT0000 complete [ 6084.068660] LustreError: 302530:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6084.089301] LustreError: 302530:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6085.764830] LustreError: 302510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781823393 with bad export cookie 17111068468211380635 [ 6085.771064] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6085.771581] LustreError: 302510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6086.277515] Lustre: server umount lustre-MDT0001 complete [ 6100.006734] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 6103.306737] Key type lgssc unregistered [ 6103.598696] LNet: 306474:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6104.691926] LNet: Removed LNI 192.168.202.157@tcp [ 6105.595518] Key type .llcrypt unregistered [ 6105.596903] Key type ._llcrypt unregistered [ 6125.949411] Key type ._llcrypt registered [ 6125.950646] Key type .llcrypt registered [ 6126.019985] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 6138.171987] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 6138.811267] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6138.830071] alg: No test for adler32 (adler32-zlib) [ 6139.824876] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 6140.107502] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 6141.767190] Key type lgssc registered [ 6142.510643] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6161.294427] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 6176.065484] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6176.082343] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6177.379934] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6177.424181] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6177.522244] Lustre: lustre-MDT0000: new disk, initializing [ 6177.631262] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6177.653320] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6182.823723] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 6191.912044] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6192.317583] Lustre: lustre-OST0000: new disk, initializing [ 6192.328842] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6192.342655] Lustre: Skipped 1 previous similar message [ 6192.347542] Lustre: 310500:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6192.537426] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6197.907447] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6197.914766] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6197.947428] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6199.359506] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 6978.762261] Lustre: server umount lustre-MDT0000 complete [ 6982.578139] LustreError: 309688:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781824290 with bad export cookie 17418915305125585602 [ 6982.594364] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6993.118311] Lustre: server umount lustre-OST0000 complete [ 7017.715593] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 7029.871383] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 7074.021339] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7074.327499] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7074.406771] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7074.513181] Lustre: lustre-MDT0000: new disk, initializing [ 7074.687367] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7074.765577] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7080.047539] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7091.794246] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7091.954931] Lustre: 314843:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7092.025757] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7092.030325] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 7092.032929] Lustre: Skipped 1 previous similar message [ 7092.100301] Lustre: lustre-MDT0001: new disk, initializing [ 7092.178521] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7092.212199] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7092.227794] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7096.774929] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7107.202888] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7113.850370] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7122.283247] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7122.505151] Lustre: lustre-OST0000: new disk, initializing [ 7122.507451] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7122.512798] Lustre: 316811:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7122.605790] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7130.297453] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7130.733060] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7130.752652] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7130.877833] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7142.140834] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7148.292432] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7148.636876] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7154.151866] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7154.277440] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7156.707719] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7156.715966] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7156.755382] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7156.782527] Lustre: Skipped 1 previous similar message [ 7161.826183] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7161.846427] Lustre: Skipped 1 previous similar message [ 7162.628956] Lustre: server umount lustre-OST0000 complete [ 7168.998812] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7169.006061] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7169.029632] Lustre: Skipped 1 previous similar message [ 7169.034809] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7172.065258] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7173.792791] Lustre: server umount lustre-MDT0000 complete [ 7178.244307] LustreError: 314835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781824485 with bad export cookie 17418915305128526414 [ 7178.251390] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7178.260415] LustreError: 314835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7178.663344] Lustre: server umount lustre-MDT0001 complete [ 7183.033400] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 7184.719804] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 19:14:51 (1781824491) [ 7191.992691] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7192.597948] LustreError: 319125:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7192.625019] LustreError: 319125:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7192.659432] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7197.664740] LustreError: 319126:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7198.076179] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7202.787760] LustreError: 319125:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7207.842551] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7207.904245] LustreError: 319126:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7208.367510] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7214.113476] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7222.192994] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7228.017734] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7234.303570] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7234.783524] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7241.590260] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7248.964570] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7256.395847] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7256.606746] Lustre: lustre-OST0001: new disk, initializing [ 7256.610781] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7256.617400] Lustre: 321960:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7256.723495] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7262.658808] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7263.874937] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7263.887432] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7263.941660] LustreError: 322368:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7265.007688] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7265.029156] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 7266.114293] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7266.137734] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 7268.203064] LustreError: 322368:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7268.219922] LustreError: 322368:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 7272.292337] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7272.321221] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 6 previous similar messages [ 7273.990944] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7274.246382] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7280.549126] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7280.561521] LustreError: 322378:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [ 7280.787396] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8f4947c87800.ost_server_uuid 50 [ 7282.749465] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8f4947c87800.ost_server_uuid in FULL state after 0 sec [ 7288.922381] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8f4947c87800.ost_server_uuid 50 [ 7290.301699] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8f4947c87800.ost_server_uuid in IDLE state after 0 sec [ 7291.836456] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7307.235320] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7307.253206] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7307.257715] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7307.274749] Lustre: Skipped 1 previous similar message [ 7307.287694] Lustre: Skipped 3 previous similar messages [ 7312.423384] Lustre: server umount lustre-OST0001 complete [ 7314.583814] LustreError: 322440:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7320.033351] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7320.034163] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7320.044034] LustreError: Skipped 2 previous similar messages [ 7320.058461] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7320.058471] Lustre: Skipped 3 previous similar messages [ 7325.675047] LustreError: 320946:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7325.697796] LustreError: 320946:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 7325.932636] Lustre: server umount lustre-OST0000 complete [ 7330.787487] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7330.814682] Lustre: Skipped 2 previous similar messages [ 7336.397358] Lustre: server umount lustre-MDT0000 complete [ 7340.492631] LustreError: 319108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781824647 with bad export cookie 17418915305128527303 [ 7340.495879] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7340.517852] LustreError: 319108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7340.899703] Lustre: server umount lustre-MDT0001 complete [ 7354.035869] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 7357.815291] Key type lgssc unregistered [ 7358.206796] LNet: 324652:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7359.273149] LNet: Removed LNI 192.168.202.157@tcp [ 7360.407362] Key type .llcrypt unregistered [ 7360.409084] Key type ._llcrypt unregistered [ 7388.608657] Key type ._llcrypt registered [ 7388.616524] Key type .llcrypt registered [ 7388.795908] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 7389.964250] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7390.154490] alg: No test for adler32 (adler32-zlib) [ 7391.304267] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 7391.582810] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 7393.343188] Key type lgssc registered [ 7394.714662] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7402.534457] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7402.547036] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7404.329863] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7409.316388] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7413.734683] LustreError: 326074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7413.751137] LustreError: 326074:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7417.284362] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7418.852738] LustreError: 326073:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7423.975627] LustreError: 326074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7425.140983] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7425.951703] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7431.976346] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7443.156358] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7443.632535] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7448.758944] LustreError: 327756:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7448.771566] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 7450.758453] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7456.229544] LustreError: 328025:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7456.248540] LustreError: 328025:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7458.628719] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7465.697524] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7466.033654] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7471.099438] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7473.527342] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7481.540193] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 7489.850901] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 7490.143559] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7593.966394] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7593.967313] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7594.010079] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7595.723496] Lustre: server umount lustre-OST0001 complete [ 7599.077186] LustreError: 328346:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7599.095086] LustreError: 328346:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7602.661384] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7602.667838] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7602.686764] Lustre: Skipped 1 previous similar message [ 7602.698520] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7602.704545] Lustre: Skipped 1 previous similar message [ 7604.214969] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7604.215186] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7604.248529] Lustre: Skipped 1 previous similar message [ 7608.579882] Lustre: server umount lustre-OST0000 complete [ 7614.434776] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7614.436529] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7614.453540] Lustre: Skipped 1 previous similar message [ 7614.468363] Lustre: Skipped 1 previous similar message [ 7618.915613] Lustre: server umount lustre-MDT0000 complete [ 7619.553763] LustreError: 326073:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7619.594868] LustreError: 326073:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7623.555394] LustreError: 326055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781824931 with bad export cookie 7045238672498279986 [ 7623.561367] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7623.577462] LustreError: 326055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7624.021443] Lustre: server umount lustre-MDT0001 complete [ 7638.448859] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 7641.419028] Key type lgssc unregistered [ 7641.773608] LNet: 331019:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7642.792663] LNet: Removed LNI 192.168.202.157@tcp [ 7643.682913] Key type .llcrypt unregistered [ 7643.687231] Key type ._llcrypt unregistered [ 7692.122368] Key type ._llcrypt registered [ 7692.124828] Key type .llcrypt registered [ 7692.220877] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 7693.026014] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7693.051106] alg: No test for adler32 (adler32-zlib) [ 7694.245787] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 7694.437783] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 7696.087217] Key type lgssc registered [ 7697.338508] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7707.030668] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7707.049339] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7708.447791] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7713.773511] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7717.857741] LustreError: 333309:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7717.890544] LustreError: 333309:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7722.993196] LustreError: 333310:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7724.452915] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7725.172677] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7730.564745] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7733.877216] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7741.168841] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7741.617643] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7748.368986] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7749.802815] LustreError: 334802:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7752.874807] LustreError: 334803:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7752.904803] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 7752.910024] LustreError: 334803:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7757.775074] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7758.028139] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7763.456373] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 7764.840628] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7774.707389] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7783.476852] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7796.709328] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7796.720449] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7796.745885] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7799.268642] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7799.272069] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7799.283440] Lustre: Skipped 2 previous similar messages [ 7799.308363] Lustre: Skipped 2 previous similar messages [ 7802.638645] Lustre: server umount lustre-MDT0000 complete [ 7804.391354] LustreError: 333309:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7804.419357] LustreError: 333309:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7806.249383] LustreError: 333291:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781825113 with bad export cookie 14198954055803674714 [ 7806.251795] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7806.287596] LustreError: 333291:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7806.678760] Lustre: server umount lustre-MDT0001 complete [ 7819.854473] Lustre: server umount lustre-OST0000 complete [ 7833.050129] Lustre: server umount lustre-OST0001 complete [ 7850.906304] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 7862.579298] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7862.942831] LustreError: 338576:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7863.041259] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7868.034355] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7876.275538] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7876.655901] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7880.877485] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7883.944074] Lustre: 339716:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7889.856861] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7896.061735] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7902.444214] LustreError: 340071:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7902.457471] LustreError: 340071:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7904.257369] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7904.604052] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7904.614624] Lustre: Skipped 1 previous similar message [ 7907.707691] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 7907.718401] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 7910.870389] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 7921.426772] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7925.640648] Lustre: 341589:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7932.897130] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7932.916273] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7932.938908] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7932.944810] Lustre: Skipped 1 previous similar message [ 7937.489758] Lustre: server umount lustre-MDT0000 complete [ 7938.542433] LustreError: 338571:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7938.569908] LustreError: 338571:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7941.665965] LustreError: 338556:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781825249 with bad export cookie 14198954055803676415 [ 7941.680533] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7942.058729] Lustre: server umount lustre-MDT0001 complete [ 7956.257215] Lustre: server umount lustre-OST0000 complete [ 7969.870708] Lustre: server umount lustre-OST0001 complete [ 7974.023793] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 7975.870160] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 7978.390783] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 19:28:04 (1781825284) [ 8009.820744] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 8021.647843] loop0: detected capacity change from 0 to 1099511627776 [ 8022.076091] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 8022.079255] *** VALIDATE xfs *** [ 8022.084580] XFS (loop0): Mounting V5 Filesystem [ 8022.097621] XFS (loop0): Ending clean mount [ 8023.512924] loop1: detected capacity change from 0 to 18691697672192 [ 8131.049468] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 8144.273537] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 8183.452459] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8183.694261] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8183.714989] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8183.774317] Lustre: lustre-MDT0000: new disk, initializing [ 8183.853498] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8183.868922] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8189.223522] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8200.320917] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8200.545249] Lustre: 346749:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8200.666088] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8200.669338] Lustre: Skipped 1 previous similar message [ 8200.755841] Lustre: lustre-MDT0001: new disk, initializing [ 8200.906989] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8200.924220] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8205.266848] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8214.247591] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8221.154280] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8228.629779] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8228.976686] Lustre: lustre-OST0000: new disk, initializing [ 8228.980541] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8228.986695] Lustre: 348720:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8230.558691] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8230.572528] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8230.784233] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8236.302828] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8247.355790] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8253.037728] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8253.245311] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8258.499527] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 8258.764346] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 8261.602954] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8261.614639] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8261.621810] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8261.641722] Lustre: Skipped 4 previous similar messages [ 8261.670028] Lustre: Skipped 5 previous similar messages [ 8266.737851] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8266.743446] Lustre: Skipped 1 previous similar message [ 8267.165360] Lustre: server umount lustre-OST0000 complete [ 8271.844566] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8276.963776] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8276.971456] Lustre: Skipped 3 previous similar messages [ 8278.028526] Lustre: server umount lustre-MDT0000 complete [ 8282.081793] LustreError: 346763:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8282.121623] LustreError: 346763:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8283.045779] LustreError: 346742:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781825590 with bad export cookie 14198954055803677969 [ 8283.059168] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8283.060991] LustreError: 346742:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 8283.690463] Lustre: server umount lustre-MDT0001 complete [ 8294.048588] XFS (loop0): Unmounting Filesystem [ 8300.857619] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 19:33:27 (1781825607) [ 8309.521451] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8310.140141] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8310.144718] Lustre: Skipped 2 previous similar messages [ 8315.933487] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8326.296383] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8331.954727] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8341.437765] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8348.518436] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8358.042104] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8366.426334] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8376.053022] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8395.749786] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8395.766534] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8395.788430] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8395.790475] Lustre: Skipped 2 previous similar messages [ 8395.821818] LustreError: Skipped 1 previous similar message [ 8400.132421] Lustre: server umount lustre-OST0000 complete [ 8419.295191] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8419.636197] Lustre: server umount lustre-MDT0000 complete [ 8421.349326] LustreError: 352009:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8421.377690] LustreError: 352009:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 8424.754228] LustreError: 351261:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781825732 with bad export cookie 14198954055803678851 [ 8424.760286] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8424.766247] LustreError: 351261:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8425.437344] Lustre: server umount lustre-MDT0001 complete [ 8439.847216] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 8444.071789] Key type lgssc unregistered [ 8444.399406] LNet: 354915:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8445.460089] LNet: Removed LNI 192.168.202.157@tcp [ 8447.042342] Key type .llcrypt unregistered [ 8447.047114] Key type ._llcrypt unregistered [ 8482.769828] Key type ._llcrypt registered [ 8482.772617] Key type .llcrypt registered [ 8482.870433] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 8484.234762] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8484.370869] alg: No test for adler32 (adler32-zlib) [ 8485.822722] Lustre: Lustre: Build Version: 2.17.54_40_g9c4a26d [ 8486.095961] LNet: Added LNI 192.168.202.157@tcp [8/256/0/180] [ 8487.832161] Key type lgssc registered [ 8489.488983] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8499.824335] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8499.838046] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8501.432946] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8506.871951] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8510.948165] LustreError: 356485:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8510.981855] LustreError: 356485:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8515.872252] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8516.079512] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 8516.289906] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8522.278403] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8530.542904] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8537.233324] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8544.434662] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8544.921185] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8552.046395] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8560.305982] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8568.494975] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.57@tcp (stopping) [ 8571.880297] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8571.918597] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8574.452907] Lustre: server umount lustre-MDT0001 complete [ 8576.992593] LustreError: 356484:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8577.014855] LustreError: 356484:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8578.698712] LustreError: 357587:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8582.114616] LustreError: 356484:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8582.131823] LustreError: 356484:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8585.284850] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8585.355731] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8585.358675] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8585.388813] Lustre: 356474:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8585.635790] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8590.846769] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8591.365420] LustreError: 359928:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8591.392580] LustreError: 359928:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8591.397351] LustreError: 356476:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8591.408671] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8591.471528] LustreError: 359937:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.157@tcp: cfg command failed: rc = -17 [ 8591.478153] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 8591.478153] [ 8896.169211] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.57@tcp (stopping) [ 8896.178802] Lustre: Skipped 2 previous similar messages [ 8898.025825] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8898.044778] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8898.063605] Lustre: Skipped 1 previous similar message [ 8901.254349] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.57@tcp (stopping) [ 8901.263148] Lustre: Skipped 2 previous similar messages [ 8910.303484] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8910.387283] Lustre: server umount lustre-MDT0001 complete [ 8911.492255] LustreError: 356481:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8911.524081] LustreError: 356481:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8921.739780] LustreError: 362821:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.57@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8921.760670] LustreError: 362821:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 8923.329493] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8923.620885] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8923.634113] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8923.674574] Lustre: 356472:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8923.855282] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 8928.076706] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 8929.277531] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8932.343903] LustreError: 368164:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8932.354430] LustreError: 368164:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8932.364424] LustreError: 356476:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8932.377503] LustreError: 356476:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8932.481750] LustreError: 368167:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 8932.488653] LustreError: 368167:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 8932.495056] LustreError: 368167:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.157@tcp: cfg command failed: rc = -17 [ 8932.512133] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.157@tcp [ 8932.512133] [ 9236.448490] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 9236.457659] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9236.464118] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9236.471102] Lustre: Skipped 2 previous similar messages [ 9236.474334] Lustre: Skipped 5 previous similar messages [ 9241.493497] Lustre: server umount lustre-MDT0001 complete [ 9241.569337] LustreError: 356480:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9241.577320] LustreError: 356480:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9253.839194] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9253.981386] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 9253.991937] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9254.042519] Lustre: 356472:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9254.373843] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 9259.507156] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 9259.714691] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 9261.064033] LustreError: 376505:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 9261.071910] LustreError: 376505:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 9261.079863] LustreError: 356476:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 9261.084342] LustreError: 356476:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 9261.149507] LustreError: 376509:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 9261.162046] LustreError: 376509:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.157@tcp: cfg command failed: rc = -114 [ 9261.170508] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 9261.170508] [ 9582.071833] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9582.074059] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9582.081887] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9582.081898] Lustre: Skipped 2 previous similar messages [ 9582.090024] Lustre: Skipped 2 previous similar messages [ 9585.939190] Lustre: server umount lustre-MDT0000 complete [ 9587.172119] LustreError: 359892:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9587.214142] LustreError: 359892:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 9590.008388] LustreError: 356465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781826897 with bad export cookie 3177787104505575412 [ 9590.016368] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9590.020871] LustreError: 356465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9592.290467] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9596.815648] Lustre: server umount lustre-MDT0001 complete [ 9601.799327] Lustre: server umount lustre-OST0000 complete [ 9612.902856] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 9624.891146] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 9665.319533] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 19:56:11 (1781826971) [ 9674.959603] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9675.404276] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9675.490336] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9675.658540] Lustre: lustre-MDT0000: new disk, initializing [ 9675.782284] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9675.800263] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9681.063667] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 9693.648453] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9693.873365] Lustre: 387021:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9693.949251] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9693.953334] Lustre: Skipped 1 previous similar message [ 9694.075247] Lustre: lustre-MDT0001: new disk, initializing [ 9694.220865] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9694.268079] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9694.297588] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9699.663981] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 9710.963376] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9717.278688] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9725.309971] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9725.770185] Lustre: lustre-OST0000: new disk, initializing [ 9725.775779] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9725.785494] Lustre: 388993:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9725.919800] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9734.231792] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9734.286067] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9734.490622] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9735.899514] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_default_debug -1 all [ 9746.561577] Lustre: DEBUG MARKER: oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9755.106377] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9755.115437] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9755.121339] Lustre: Skipped 1 previous similar message [ 9755.146434] Lustre: Skipped 5 previous similar messages [ 9756.961712] Lustre: server umount lustre-MDT0000 complete [ 9760.228279] LustreError: 389174:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9760.246316] LustreError: 389174:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 9761.182348] LustreError: 387818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781827068 with bad export cookie 3177787104505577365 [ 9761.200396] LustreError: MGC192.168.202.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9761.202471] LustreError: 387818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9761.213194] LustreError: 387830:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 9761.906255] Lustre: server umount lustre-MDT0001 complete [ 9778.479902] Lustre: server umount lustre-OST0000 complete [ 9810.902536] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing set_hostid [ 9823.058520] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing load_modules_local [ 9860.028158] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 9618 sec ========== 19:59:26 (1781827166) [ 9861.821639] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 19:59:28 (1781827168) === [ 9865.905552] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 19:59:32 (1781827172) === [ 9911.509044] Lustre: DEBUG MARKER: oleg257-server.virtnet: executing unload_modules_local [ 9914.481501] Key type lgssc unregistered [ 9914.754674] LNet: 395364:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9915.818894] LNet: Removed LNI 192.168.202.157@tcp [ 9916.729732] Key type .llcrypt unregistered [ 9916.731866] Key type ._llcrypt unregistered