[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 560594700 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2400.000 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002000] x2apic enabled [ 0.002000] Switched APIC routing to physical x2apic. [ 0.002000] kvm-guest: setup PV IPIs [ 0.002000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.002000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 0.002000] Calibrating delay loop (skipped) preset value.. 4800.00 BogoMIPS (lpj=2400000) [ 0.002013] pid_max: default: 32768 minimum: 301 [ 0.003120] LSM: Security Framework initializing [ 0.005037] Yama: becoming mindful. [ 0.006000] SELinux: Initializing. [ 0.006063] *** VALIDATE selinux *** [ 0.014788] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.019396] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.020000] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.020000] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.020191] *** VALIDATE tmpfs *** [ 0.021765] *** VALIDATE proc *** [ 0.022000] *** VALIDATE cgroup *** [ 0.022007] *** VALIDATE cgroup2 *** [ 0.024131] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.025150] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.026004] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.027021] Spectre V2 : User space: Vulnerable [ 0.028005] Speculative Store Bypass: Vulnerable [ 0.030896] debug: unmapping init [mem 0xffffffff92659000-0xffffffff92660fff] [ 0.034000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.034672] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.035081] ... version: 2 [ 0.036008] ... bit width: 48 [ 0.037006] ... generic registers: 4 [ 0.038006] ... value mask: 0000ffffffffffff [ 0.039008] ... max period: 00007fffffffffff [ 0.040008] ... fixed-purpose events: 3 [ 0.041007] ... event mask: 000000070000000f [ 0.042340] rcu: Hierarchical SRCU implementation. [ 0.044752] smp: Bringing up secondary CPUs ... [ 0.045769] x86: Booting SMP configuration: [ 0.046013] .... node #0, CPUs: #1 #2 #3 [ 0.049373] smp: Brought up 1 node, 4 CPUs [ 0.051016] smpboot: Max logical packages: 1 [ 0.052023] smpboot: Total of 4 processors activated (19200.00 BogoMIPS) [ 0.091044] node 0 deferred pages initialised in 36ms [ 0.097779] devtmpfs: initialized [ 0.099500] x86/mm: Memory block size: 128MB [ 0.105141] gcov: version magic: 0x41383552 [ 0.108304] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.113055] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.117552] pinctrl core: initialized pinctrl subsystem [ 0.119144] [ 0.120006] ************************************************************* [ 0.125010] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.132009] ** ** [ 0.136008] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.140016] ** ** [ 0.144007] ** This means that this kernel is built to expose internal ** [ 0.148008] ** IOMMU data structures, which may compromise security on ** [ 0.152008] ** your system. ** [ 0.154011] ** ** [ 0.158010] ** If you see this message and you are not debugging the ** [ 0.161010] ** kernel, report this immediately to your vendor! ** [ 0.163006] ** ** [ 0.167016] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.170010] ************************************************************* [ 0.172782] NET: Registered protocol family 16 [ 0.175529] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.179047] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.183042] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.188041] cpuidle: using governor menu [ 0.189976] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.193557] PCI: Using configuration type 1 for base access [ 0.196153] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.207193] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.208019] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.210201] cryptd: max_cpu_qlen set to 1000 [ 0.212153] ACPI: Added _OSI(Module Device) [ 0.213008] ACPI: Added _OSI(Processor Device) [ 0.214028] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.215007] ACPI: Added _OSI(Processor Aggregator Device) [ 0.221184] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.229635] ACPI: Interpreter enabled [ 0.231042] ACPI: PM: (supports S0 S3 S4 S5) [ 0.233024] ACPI: Using IOAPIC for interrupt routing [ 0.235321] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.241387] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.255067] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.258070] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.262014] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.267066] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.274046] acpiphp: Slot [2] registered [ 0.276084] acpiphp: Slot [5] registered [ 0.279127] acpiphp: Slot [6] registered [ 0.281176] acpiphp: Slot [7] registered [ 0.283072] acpiphp: Slot [8] registered [ 0.285076] acpiphp: Slot [9] registered [ 0.286211] acpiphp: Slot [10] registered [ 0.288080] acpiphp: Slot [3] registered [ 0.290070] acpiphp: Slot [4] registered [ 0.291000] acpiphp: Slot [11] registered [ 0.291000] acpiphp: Slot [12] registered [ 0.293091] acpiphp: Slot [13] registered [ 0.296196] acpiphp: Slot [14] registered [ 0.298073] acpiphp: Slot [15] registered [ 0.300066] acpiphp: Slot [16] registered [ 0.301103] acpiphp: Slot [17] registered [ 0.303064] acpiphp: Slot [18] registered [ 0.305095] acpiphp: Slot [19] registered [ 0.307065] acpiphp: Slot [20] registered [ 0.308159] acpiphp: Slot [21] registered [ 0.311146] acpiphp: Slot [22] registered [ 0.313120] acpiphp: Slot [23] registered [ 0.316099] acpiphp: Slot [24] registered [ 0.318077] acpiphp: Slot [25] registered [ 0.320084] acpiphp: Slot [26] registered [ 0.322189] acpiphp: Slot [27] registered [ 0.324071] acpiphp: Slot [28] registered [ 0.326078] acpiphp: Slot [29] registered [ 0.328069] acpiphp: Slot [30] registered [ 0.331069] acpiphp: Slot [31] registered [ 0.332041] PCI host bridge to bus 0000:00 [ 0.335014] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.338024] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.341015] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.345056] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.349098] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.354018] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.357259] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.361859] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.367099] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.380874] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.387057] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.390020] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.393011] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.395016] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.398261] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.399000] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.400028] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.403954] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.411012] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.425013] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.433011] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.440509] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.447013] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.461013] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.482013] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.495201] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.502010] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.510036] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.534013] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.548050] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.557017] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.567018] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.581017] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.592250] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.599017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.606018] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.620028] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.630988] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.638015] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.643031] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.661020] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.673270] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.681020] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.691018] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.708024] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.719877] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.722561] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.725539] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.729437] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.732275] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.738259] iommu: Default domain type: Passthrough [ 0.740450] SCSI subsystem initialized [ 0.742106] ACPI: bus type USB registered [ 0.744085] usbcore: registered new interface driver usbfs [ 0.746091] usbcore: registered new interface driver hub [ 0.748069] usbcore: registered new device driver usb [ 0.751253] pps_core: LinuxPPS API ver. 1 registered [ 0.753010] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.756083] PTP clock support registered [ 0.758078] EDAC MC: Ver: 3.0.0 [ 0.760167] PCI: Using ACPI for IRQ routing [ 0.763826] NetLabel: Initializing [ 0.766015] NetLabel: domain hash size = 128 [ 0.769016] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.772102] NetLabel: unlabeled traffic allowed by default [ 0.775066] vgaarb: loaded [ 0.776532] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.778015] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.786000] clocksource: Switched to clocksource kvm-clock [ 0.915604] VFS: Disk quotas dquot_6.6.0 [ 0.918378] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.923971] *** VALIDATE ramfs *** [ 0.926991] *** VALIDATE hugetlbfs *** [ 0.930687] pnp: PnP ACPI init [ 0.935996] pnp: PnP ACPI: found 6 devices [ 0.954323] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.961569] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.964942] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.969491] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.972712] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.978361] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.984492] NET: Registered protocol family 2 [ 0.987944] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.997510] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.002702] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.010379] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.014886] TCP: Hash tables configured (established 65536 bind 65536) [ 1.018699] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.022245] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.025317] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.028754] NET: Registered protocol family 1 [ 1.033539] RPC: Registered named UNIX socket transport module. [ 1.036355] RPC: Registered udp transport module. [ 1.038359] RPC: Registered tcp transport module. [ 1.040495] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.043576] NET: Registered protocol family 44 [ 1.045773] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.048509] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.051102] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.053925] PCI: CLS 0 bytes, default 64 [ 1.056201] Unpacking initramfs... [ 2.727499] debug: unmapping init [mem 0xffff9ff9bcc54000-0xffff9ff9bffbffff] [ 2.731826] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.734436] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.737786] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 3.284075] Initialise system trusted keyrings [ 3.286446] Key type blacklist registered [ 3.288086] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.297768] zbud: loaded [ 3.301083] *** VALIDATE nfs *** [ 3.302404] *** VALIDATE nfs4 *** [ 3.303825] pstore: using deflate compression [ 3.308339] Platform Keyring initialized [ 3.436234] NET: Registered protocol family 38 [ 3.438335] Key type asymmetric registered [ 3.440941] Asymmetric key parser 'x509' registered [ 3.442967] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.446559] io scheduler mq-deadline registered [ 3.448180] io scheduler kyber registered [ 3.450331] io scheduler bfq registered [ 3.451908] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.455549] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.458484] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.461787] ACPI: Power Button [PWRF] [ 3.467262] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.473860] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.487973] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.502433] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.545178] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.574740] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.611115] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.616487] Non-volatile memory driver v1.3 [ 3.618054] Linux agpgart interface v0.103 [ 3.647613] virtio_blk virtio1: [vda] 140344 512-byte logical blocks (71.9 MB/68.5 MiB) [ 3.650561] vda: detected capacity change from 0 to 71856128 [ 3.683339] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.685691] vdb: detected capacity change from 0 to 1073741824 [ 3.704589] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.706813] vdc: detected capacity change from 0 to 2621440000 [ 3.727884] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.730415] vdd: detected capacity change from 0 to 2621440000 [ 3.750751] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.754172] vde: detected capacity change from 0 to 4294967296 [ 3.771676] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.774222] vdf: detected capacity change from 0 to 4294967296 [ 3.786533] libphy: Fixed MDIO Bus: probed [ 3.790959] usbcore: registered new interface driver usbserial_generic [ 3.793889] usbserial: USB Serial support registered for generic [ 3.795993] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.799965] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.802029] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.806350] mousedev: PS/2 mouse device common for all mice [ 3.809889] rtc_cmos 00:05: RTC can wake from S4 [ 3.813084] rtc_cmos 00:05: registered as rtc0 [ 3.814766] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.819285] intel_pstate: CPU model not supported [ 3.821845] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.828224] hid: raw HID events driver (C) Jiri Kosina [ 3.831330] usbcore: registered new interface driver usbhid [ 3.834508] usbhid: USB HID core driver [ 3.835949] drop_monitor: Initializing network drop monitor service [ 3.839649] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.840685] Initializing XFRM netlink socket [ 3.842230] NET: Registered protocol family 10 [ 3.846160] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.853912] Segment Routing with IPv6 [ 3.855385] NET: Registered protocol family 17 [ 3.858457] mpls_gso: MPLS GSO support [ 3.864781] RAS: Correctable Errors collector initialized. [ 3.866714] AVX version of gcm_enc/dec engaged. [ 3.868377] AES CTR mode by8 optimization enabled [ 3.961334] sched_clock: Marking stable (3961318496, 0)->(5017740320, -1056421824) [ 3.965472] registered taskstats version 1 [ 3.967789] Loading compiled-in X.509 certificates [ 3.971696] zswap: loaded using pool lzo/zbud [ 3.997511] Key type big_key registered [ 4.010150] Key type encrypted registered [ 4.012165] ima: No TPM chip found, activating TPM-bypass! [ 4.014602] ima: Allocated hash algorithm: sha1 [ 4.016618] ima: No architecture policies found [ 4.018382] evm: Initialising EVM extended attributes: [ 4.020445] evm: security.selinux [ 4.021839] evm: security.ima [ 4.023180] evm: security.capability [ 4.024678] evm: HMAC attrs: 0x1 [ 4.027404] rtc_cmos 00:05: setting system clock to 2026-04-28 23:59:55 UTC (1777420795) [ 4.035587] debug: unmapping init [mem 0xffffffff93603000-0xffffffff937fffff] [ 4.038731] debug: unmapping init [mem 0xffffffff92382000-0xffffffff92658fff] [ 4.047179] Write protecting the kernel read-only data: 28672k [ 4.050168] debug: unmapping init [mem 0xffffffff90a03000-0xffffffff90bfffff] [ 4.053308] debug: unmapping init [mem 0xffffffff91314000-0xffffffff913fffff] [ 4.098467] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.107974] systemd[1]: Detected virtualization kvm. [ 4.110307] systemd[1]: Detected architecture x86-64. [ 4.112561] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.144849] systemd[1]: No hostname configured. [ 4.147882] systemd[1]: Set hostname to . [ 4.152796] random: systemd: uninitialized urandom read (16 bytes read) [ 4.155904] systemd[1]: Initializing machine ID from random generator. [ 4.216784] random: ln: uninitialized urandom read (6 bytes read) [ 4.316652] random: systemd: uninitialized urandom read (16 bytes read) [ 4.318990] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 4.323366] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 4.328442] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket. Starting Create list of required st…ce nodes for the current kernel... Starting Setup Virtual Console... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Slices. Starting Apply Kernel Variables... [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Swap. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 5.380235] device-mapper: uevent: version 1.0.3 [ 5.384333] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 6.456044] virtio_net virtio0 ens2: renamed from eth0 [ 6.487474] random: fast init done [ 6.887668] scsi host0: ata_piix [ 6.986259] scsi host1: ata_piix [ 6.989660] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 6.994317] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 11.539189] random: crng init done [ 11.541640] random: 7 urandom warning(s) missed due to ratelimiting [ 11.984254] dracut-initqueue[589]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 13.451851] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Timers. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 15.065017] printk: systemd: 26 output lines suppressed due to ratelimiting [ 15.441554] SELinux: Disabled at runtime. [ 15.562754] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 15.570651] systemd[1]: Detected virtualization kvm. [ 15.572221] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 16.397177] systemd[1]: initrd-switch-root.service: Succeeded. [ 16.403316] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 16.413279] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 16.419161] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 16.422057] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 16.428226] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.448358] systemd[1]: Listening on Process Core Dump Socket. [ OK ] Listening on Process Core Dump Socket. [ OK ] Created slice system-serial\x2dgetty.slice. Mounting POSIX Message Queue File System... [ OK ] Listening on RPCbind Server Activation Socket. Starting Create list of required st…ce nodes for the current kernel... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-getty.slice. [ OK ] Created slice User and Session Slice. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Slices. Mounting Huge Pages File System... [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Control Socket. [ 16.600067] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Kernel Debug File System... Starting Apply Kernel Variables... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... Starting Remount Root and Kernel File Systems... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Started udev Coldplug all Devices. [ OK ] [ 17.517682] squashfs: version 4.0 (2009/01/31) Phillip Lougher Mounted /mnt. [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 18.185312] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 18.356208] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 19.060816] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 19.119916] EDAC sbridge: Ver: 1.1.2 [ 21.113662] Key type dns_resolver registered [ 21.725286] NFS: Registering the id_resolver key type [ 21.731487] Key type id_resolver registered [ 21.735298] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Login Service... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... [ OK ] Started Login Service. [ OK ] Started OpenSSH server daemon. Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. [ OK ] Started Authorization Manager. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg456-server login: [ 44.853142] libcfs: loading out-of-tree module taints kernel. [ 44.867864] Key type ._llcrypt registered [ 44.868774] Key type .llcrypt registered [ 44.899668] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 51.478181] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 51.946736] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 51.951801] alg: No test for adler32 (adler32-zlib) [ 52.905713] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 53.139280] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 54.735079] Key type lgssc registered [ 55.268117] Lustre: Echo OBD driver; http://www.lustre.org/ [ 61.596662] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 74.323262] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 78.363614] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 78.371085] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 79.452139] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 79.465141] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 79.499538] Lustre: lustre-MDT0000: new disk, initializing [ 79.522160] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 79.530397] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 80.668362] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 85.483633] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 85.519939] Lustre: 6499:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 85.530949] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 85.533362] Lustre: Skipped 1 previous similar message [ 85.565765] Lustre: lustre-MDT0001: new disk, initializing [ 85.584818] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 85.593843] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 85.597847] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 86.756754] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 88.857894] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 91.654913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 91.738383] Lustre: lustre-OST0000: new disk, initializing [ 91.740762] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 91.743114] Lustre: 8404:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 91.758596] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 93.405484] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 98.519858] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 98.567710] Lustre: lustre-OST0001: new disk, initializing [ 98.570455] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 98.573461] Lustre: lustre-OST0001: Not available for connect from 0@lo (not set up) [ 98.575612] Lustre: 9451:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 98.579581] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 98.583783] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 98.594103] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 98.611825] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 100.389325] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 103.906762] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 103.912114] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 103.927819] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 106.143941] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 110.687186] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 117.592860] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing check_logdir /tmp/testlogs/ [ 119.007302] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing yml_node [ 120.306515] Lustre: DEBUG MARKER: Client: 2.17.50.193 [ 121.089150] Lustre: DEBUG MARKER: MDS: 2.17.50.193 [ 121.874908] Lustre: DEBUG MARKER: OSS: 2.17.50.193 [ 122.387340] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Apr 28 20:01:54 EDT 2026 [ 127.817673] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 128.341178] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 141.797045] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 141.814254] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 141.830874] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 144.869805] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 144.873867] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 144.878298] Lustre: Skipped 1 previous similar message [ 144.891127] Lustre: Skipped 1 previous similar message [ 147.039966] Lustre: server umount lustre-MDT0000 complete [ 151.715352] LustreError: 10256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777420943 with bad export cookie 13619617827959426506 [ 151.717093] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 151.723453] LustreError: 10256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 155.103650] LustreError: 6505:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 155.103934] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 155.113200] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 155.113415] Lustre: Skipped 2 previous similar messages [ 155.114125] LustreError: 6505:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 155.130434] Lustre: Skipped 2 previous similar messages [ 156.128929] LustreError: 6507:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 156.156935] LustreError: 6507:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 161.259596] LustreError: 6507:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 161.259828] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 161.269796] LustreError: 6507:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 161.277731] Lustre: Skipped 4 previous similar messages [ 165.855240] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 166.077957] Lustre: server umount lustre-MDT0001 complete [ 185.311116] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 185.357205] Lustre: server umount lustre-OST0000 complete [ 193.510283] Lustre: server umount lustre-OST0001 complete [ 196.662606] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 201.762537] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 219.702891] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 219.887908] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 219.913241] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 219.966921] Lustre: lustre-MDT0000: new disk, initializing [ 220.034980] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 220.045206] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 222.042599] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 227.359542] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 227.427245] Lustre: 14966:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 227.591023] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 229.556608] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 233.892960] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 235.713505] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 239.069737] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 239.231242] Lustre: lustre-OST0000: new disk, initializing [ 239.234534] Lustre: Skipped 1 previous similar message [ 239.241220] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 239.245091] Lustre: Skipped 2 previous similar messages [ 239.249170] Lustre: 16706:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 239.296934] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 239.302443] Lustre: Skipped 1 previous similar message [ 240.539825] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 240.546597] Lustre: Skipped 1 previous similar message [ 240.549101] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 240.605675] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 242.382176] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 246.957962] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 249.251882] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 249.405441] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 251.833203] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 251.949934] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 255.968629] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 255.972866] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 255.977442] Lustre: Skipped 1 previous similar message [ 255.982183] Lustre: Skipped 3 previous similar messages [ 259.193226] Lustre: server umount lustre-OST0000 complete [ 263.648835] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 263.652832] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 267.504273] Lustre: server umount lustre-MDT0000 complete [ 269.289902] LustreError: 14960:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421060 with bad export cookie 13619617827959427955 [ 269.292736] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 269.296667] LustreError: 14960:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 269.472248] Lustre: server umount lustre-MDT0001 complete [ 271.953265] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 20:04:23 (1777421063) [ 273.703012] hrtimer: interrupt took 2004421 ns [ 275.146156] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 275.394138] LustreError: 18824:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 275.404575] LustreError: 18824:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 275.439692] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 277.325778] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 280.545778] LustreError: 18824:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 281.369599] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 283.291532] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 286.060775] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 287.779242] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 291.046921] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 293.721981] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 296.201478] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 303.532948] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 307.167822] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 307.170775] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 307.175631] Lustre: Skipped 1 previous similar message [ 307.178563] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 307.185476] Lustre: Skipped 3 previous similar messages [ 313.248144] Lustre: server umount lustre-MDT0000 complete [ 314.924790] LustreError: 18804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421106 with bad export cookie 13619617827959428837 [ 314.928381] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 314.931090] LustreError: 18804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 315.065802] Lustre: server umount lustre-MDT0001 complete [ 327.358947] Lustre: server umount lustre-OST0000 complete [ 337.638664] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 342.586844] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 342.821606] LustreError: 22850:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 342.868043] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 342.873581] Lustre: Skipped 2 previous similar messages [ 345.062983] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 349.974097] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 352.580333] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 354.325735] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 358.106745] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 361.860762] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 367.097548] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 367.219558] Lustre: lustre-OST0001: new disk, initializing [ 367.222467] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 367.227356] Lustre: 25112:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 368.731315] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 368.738184] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 368.784509] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 370.929646] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 377.209802] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 379.352604] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 393.835640] Lustre: server umount lustre-MDT0000 complete [ 394.739840] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 394.743796] LustreError: 22850:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 394.754911] Lustre: Skipped 5 previous similar messages [ 394.768237] LustreError: 22850:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 396.112313] LustreError: 22831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421187 with bad export cookie 13619617827959429684 [ 396.118851] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 396.119563] LustreError: 22831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 396.301824] Lustre: server umount lustre-MDT0001 complete [ 408.082484] Lustre: server umount lustre-OST0000 complete [ 419.669277] Lustre: server umount lustre-OST0001 complete [ 428.117972] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 433.390954] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 433.620206] LustreError: 28096:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 433.675346] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 433.679053] Lustre: Skipped 3 previous similar messages [ 435.602628] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 439.872359] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 442.046942] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 443.252933] Lustre: 29209:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 446.095855] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 448.819448] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 452.553986] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 455.434680] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 464.750167] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 466.356399] Lustre: 31058:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 474.594198] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 474.598564] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 474.604942] Lustre: Skipped 2 previous similar messages [ 474.607788] Lustre: Skipped 4 previous similar messages [ 479.593638] Lustre: server umount lustre-MDT0000 complete [ 481.430429] LustreError: 31262:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421272 with bad export cookie 13619617827959430979 [ 481.434059] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 481.440307] LustreError: 31262:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 481.606911] Lustre: server umount lustre-MDT0001 complete [ 494.107520] Lustre: server umount lustre-OST0000 complete [ 506.348406] Lustre: server umount lustre-OST0001 complete [ 510.181609] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 20:08:21 (1777421301) [ 523.920132] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 529.096989] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 529.357381] LustreError: 33841:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 529.372979] LustreError: 33841:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 531.565993] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 536.084252] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 538.406223] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 539.863769] Lustre: 34954:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 543.177181] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 546.186280] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 550.590053] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 553.793715] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 558.030626] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 559.802425] Lustre: 36804:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 567.264697] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 567.274388] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 567.281416] Lustre: Skipped 1 previous similar message [ 567.285557] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 567.289042] Lustre: Skipped 2 previous similar messages [ 573.368483] Lustre: server umount lustre-MDT0000 complete [ 575.112426] LustreError: 33822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421366 with bad export cookie 13619617827959432078 [ 575.116329] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 575.119075] LustreError: 33822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 575.281956] Lustre: server umount lustre-MDT0001 complete [ 586.768067] Lustre: server umount lustre-OST0000 complete [ 599.097307] Lustre: server umount lustre-OST0001 complete [ 603.875517] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 20:09:55 (1777421395) [ 612.727845] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 618.727452] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 619.051928] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 619.055786] Lustre: Skipped 7 previous similar messages [ 621.420328] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 626.210923] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 628.684899] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 630.342726] Lustre: 40042:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 634.076447] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 637.428311] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 641.530227] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 644.469690] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 648.823708] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 656.051043] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 656.054799] Lustre: Skipped 1 previous similar message [ 663.598105] Lustre: server umount lustre-MDT0000 complete [ 665.317386] LustreError: 38910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421456 with bad export cookie 13619617827959433191 [ 665.319152] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 665.322839] LustreError: 38910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 666.053107] LustreError: 40420:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 666.065384] LustreError: 40420:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 11 previous similar messages [ 671.518595] Lustre: server umount lustre-MDT0001 complete [ 675.349252] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 689.631881] LustreError: 3635:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9ff9074b8700 x1863760839235968/t0(0) o250->MGC192.168.204.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 691.513412] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 695.288360] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 697.239129] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 699.434940] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 699.622948] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 702.278474] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 2 sec [ 703.774421] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 704.552956] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 710.113938] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 710.117954] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 710.122306] Lustre: Skipped 12 previous similar messages [ 710.124444] Lustre: Skipped 17 previous similar messages [ 712.949547] Lustre: server umount lustre-MDT0000 complete [ 714.641115] LustreError: 38909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421506 with bad export cookie 13619617827959434367 [ 714.645369] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 714.646233] LustreError: 38909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 714.802829] Lustre: server umount lustre-MDT0001 complete [ 726.866825] Lustre: server umount lustre-OST0000 complete [ 738.947834] Lustre: server umount lustre-OST0001 complete [ 743.222289] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 20:12:14 (1777421534) [ 750.387055] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 754.865728] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 756.797626] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 760.580287] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 762.615268] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 764.003941] Lustre: 47382:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 764.008925] Lustre: 47382:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message [ 767.514855] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 770.649970] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 775.204798] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 778.406291] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 787.686711] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 794.808366] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 808.243630] Lustre: server umount lustre-MDT0000 complete [ 809.789349] LustreError: 49237:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421601 with bad export cookie 13619617827959435165 [ 809.792387] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 809.796399] LustreError: 49237:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 809.930731] Lustre: server umount lustre-MDT0001 complete [ 820.690659] Lustre: server umount lustre-OST0000 complete [ 832.483333] Lustre: server umount lustre-OST0001 complete [ 836.269407] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 20:13:47 (1777421627) [ 837.261335] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 837.994875] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 20:13:49 (1777421629) [ 841.945282] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 845.268600] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 854.363588] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 854.470734] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 854.510340] Lustre: lustre-MDT0000: new disk, initializing [ 854.551204] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 856.078725] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 859.631687] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 862.382102] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 862.504031] Lustre: 53282:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 864.331444] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 864.343090] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 864.814302] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 868.352715] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 869.200263] Lustre: DEBUG MARKER: create test files [ 884.705484] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 887.329639] Lustre: server umount lustre-OST0000 complete [ 888.950212] Lustre: server umount lustre-MDT0000 complete [ 893.086401] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 894.355456] Key type lgssc unregistered [ 894.502064] LNet: 54776:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 894.507260] LNetError: 54776:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 894.519481] LNet: Removed LNI 192.168.204.156@tcp [ 894.936420] Key type .llcrypt unregistered [ 894.938929] Key type ._llcrypt unregistered [ 907.434335] Key type ._llcrypt registered [ 907.435853] Key type .llcrypt registered [ 907.484835] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 907.970704] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 907.980521] alg: No test for adler32 (adler32-zlib) [ 908.860479] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 908.964582] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 910.559252] Key type lgssc registered [ 911.043410] Lustre: Echo OBD driver; http://www.lustre.org/ [ 914.358366] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 914.370947] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 915.573850] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 917.115828] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 919.317303] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 922.282905] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 922.430115] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 924.724928] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 925.545372] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 925.600064] Lustre: 57359:0:(osd_internal.h:1455:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 925.604809] Lustre: 57359:0:(osd_handler.c:2093:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 925.607985] Lustre: 57359:0:(osd_handler.c:2100:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 925.613370] Lustre: 57359:0:(osd_handler.c:2110:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 925.617687] Lustre: 57359:0:(osd_handler.c:2117:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 925.621076] Lustre: 57359:0:(osd_handler.c:2124:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 927.041245] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 930.203681] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 932.122352] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 935.905244] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 935.905363] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 935.916971] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 940.254497] Lustre: server umount lustre-OST0000 complete [ 942.087488] Lustre: server umount lustre-MDT0000 complete [ 946.386902] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 947.571591] Key type lgssc unregistered [ 947.723592] LNet: 58833:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 947.728333] LNetError: 58833:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 947.737299] LNet: Removed LNI 192.168.204.156@tcp [ 948.069232] Key type .llcrypt unregistered [ 948.070791] Key type ._llcrypt unregistered [ 960.898894] Key type ._llcrypt registered [ 960.900552] Key type .llcrypt registered [ 960.950647] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 961.435146] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 961.448970] alg: No test for adler32 (adler32-zlib) [ 962.325556] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 962.420283] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 964.015152] Key type lgssc registered [ 964.452414] Lustre: Echo OBD driver; http://www.lustre.org/ [ 967.662643] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 967.673483] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 968.873944] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 970.419129] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 972.596248] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 975.324403] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 975.463786] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 977.610616] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 979.558079] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 979.598220] Lustre: 61521:0:(osd_internal.h:1455:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 979.603847] Lustre: 61521:0:(osd_handler.c:2093:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 979.608762] Lustre: 61521:0:(osd_handler.c:2100:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 979.612571] Lustre: 61521:0:(osd_handler.c:2110:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 979.615970] Lustre: 61521:0:(osd_handler.c:2117:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 979.619682] Lustre: 61521:0:(osd_handler.c:2124:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 979.737309] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 982.928264] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 987.738621] Lustre: server umount lustre-OST0000 complete [ 999.493735] Lustre: server umount lustre-MDT0000 complete [ 1007.570553] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 1010.073778] Key type lgssc unregistered [ 1010.292527] LNet: 62952:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1010.296632] LNetError: 62952:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1010.307733] LNet: Removed LNI 192.168.204.156@tcp [ 1010.835120] Key type .llcrypt unregistered [ 1010.837151] Key type ._llcrypt unregistered [ 1024.439745] Key type ._llcrypt registered [ 1024.441976] Key type .llcrypt registered [ 1024.521334] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 1036.483149] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1037.495104] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1037.504718] alg: No test for adler32 (adler32-zlib) [ 1038.507616] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 1038.691933] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 1040.359223] Key type lgssc registered [ 1041.134950] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1076.348446] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1076.363131] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1077.545592] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1077.583965] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1077.644204] Lustre: lustre-MDT0000: new disk, initializing [ 1077.717172] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1077.737223] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1080.659837] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1087.762646] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1087.817638] Lustre: 66049:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1087.868772] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1087.873985] Lustre: Skipped 1 previous similar message [ 1087.923080] Lustre: lustre-MDT0001: new disk, initializing [ 1087.985978] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1088.017380] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1088.029376] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1090.609158] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1095.673499] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1097.855208] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1101.298298] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1101.444347] Lustre: lustre-OST0000: new disk, initializing [ 1101.447923] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1101.457786] Lustre: 67791:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1101.518275] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1104.911352] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1107.506655] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1107.515727] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1107.575844] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1110.008722] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1112.140610] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1112.237393] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1114.504535] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1114.638790] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1117.669863] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1117.670615] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1117.679348] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1117.686626] Lustre: Skipped 1 previous similar message [ 1121.903587] Lustre: server umount lustre-OST0000 complete [ 1127.907893] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1127.913322] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1127.916467] Lustre: Skipped 1 previous similar message [ 1127.925428] Lustre: Skipped 1 previous similar message [ 1130.642438] Lustre: server umount lustre-MDT0000 complete [ 1132.799443] LustreError: 66043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777421924 with bad export cookie 17494769948750677910 [ 1132.804259] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1132.806614] LustreError: 66043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1133.013799] Lustre: server umount lustre-MDT0001 complete [ 1138.783823] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 20:18:49 (1777421929) [ 1145.983530] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1169.289634] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 1175.069745] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1195.872461] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1196.014901] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1196.040054] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1196.100801] Lustre: lustre-MDT0000: new disk, initializing [ 1196.154033] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1196.170157] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1198.471163] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1204.640966] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1204.722819] Lustre: 73603:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1204.760481] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1204.764206] Lustre: Skipped 1 previous similar message [ 1204.840343] Lustre: lustre-MDT0001: new disk, initializing [ 1204.916537] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1204.943753] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1204.951133] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1207.032942] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1211.518705] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1213.627123] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1217.590239] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1217.791620] Lustre: lustre-OST0000: new disk, initializing [ 1217.795575] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1217.800771] Lustre: 75343:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1217.870244] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1221.735959] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1224.219709] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1224.234849] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1224.290578] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1226.694977] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1229.304109] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1229.425102] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1232.052866] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1232.232431] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1234.405028] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1234.411644] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1234.414731] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1234.421268] Lustre: Skipped 1 previous similar message [ 1234.432221] Lustre: Skipped 2 previous similar messages [ 1239.527645] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1239.532337] Lustre: Skipped 1 previous similar message [ 1239.712993] Lustre: server umount lustre-OST0000 complete [ 1244.643856] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1244.647045] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1244.653981] Lustre: Skipped 1 previous similar message [ 1244.664490] Lustre: Skipped 1 previous similar message [ 1248.609437] Lustre: server umount lustre-MDT0000 complete [ 1251.117256] LustreError: 73595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422042 with bad export cookie 17494769948750678792 [ 1251.120733] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1251.124663] LustreError: 73595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1251.417385] Lustre: server umount lustre-MDT0001 complete [ 1257.208168] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 20:20:48 (1777422048) [ 1261.476624] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1261.773951] LustreError: 77604:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1261.790138] LustreError: 77604:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1261.842783] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1264.663968] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1267.168858] LustreError: 77604:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1270.890049] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1274.182875] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1278.306615] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1281.084573] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1285.817164] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1289.316022] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1292.418324] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1294.372844] Lustre: 79934:0:(genops.c:1793:obd_export_evict_by_uuid()) MGS: evicting aacee899-4b66-4047-854b-a9816c64fcde at adminstrative request [ 1295.328816] LustreError: MGC192.168.204.156@tcp: operation ldlm_enqueue to node 0@lo failed: rc = -107 [ 1295.334449] LustreError: Skipped 1 previous similar message [ 1295.338375] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1295.345202] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1295.345253] Lustre: 77595:0:(mgc_request.c:1911:mgc_process_log()) MGC192.168.204.156@tcp: IR log lustre-mdtir failed, not fatal: rc = -107 [ 1305.504317] Lustre: MGS: Client aacee899-4b66-4047-854b-a9816c64fcde (at 0@lo) reconnecting [ 1305.509115] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xf2c9e893be768e6c to 0xf2c9e893be7690f0 [ 1305.514795] Lustre: MGC192.168.204.156@tcp: Connection restored to 0@lo (at 0@lo) [ 1327.804728] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1327.908173] Lustre: lustre-OST0001: new disk, initializing [ 1327.911524] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1327.915699] Lustre: 80332:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1327.955562] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1327.959897] Lustre: Skipped 2 previous similar messages [ 1331.030883] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1334.888257] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1336.039298] Lustre: server umount lustre-OST0001 complete [ 1337.347789] LustreError: 79199:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1338.335981] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1338.339682] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1338.345421] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1342.434111] LustreError: 79961:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1342.435100] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1342.440955] LustreError: 79961:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 1343.701212] Lustre: server umount lustre-OST0000 complete [ 1347.552797] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1347.558833] Lustre: Skipped 2 previous similar messages [ 1351.262645] Lustre: server umount lustre-MDT0000 complete [ 1352.665748] LustreError: 77585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422144 with bad export cookie 17494769948750680304 [ 1352.667071] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1352.670382] LustreError: 77585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1352.809328] Lustre: server umount lustre-MDT0001 complete [ 1356.000753] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 20:22:27 (1777422147) [ 1356.589704] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1357.224462] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 20:22:28 (1777422148) [ 1357.805108] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1358.486268] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 20:22:30 (1777422150) [ 1359.084697] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1359.757126] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 20:22:31 (1777422151) [ 1360.353336] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1360.981094] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 20:22:32 (1777422152) [ 1361.573304] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1363.722892] loop: module loaded [ 1363.727967] loop0: detected capacity change from 0 to 4294967296 [ 1363.746307] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1364.338063] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1365.470205] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1367.033200] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1377.161611] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1377.185226] LustreError: 84314:0:(obd_config.c:880:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1377.188160] LustreError: 84314:0:(obd_mount.c:217:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1377.192373] LustreError: 84314:0:(tgt_mount.c:2547:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1377.195880] LustreError: 84314:0:(super25.c:190:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1384.773073] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 1388.700635] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1404.272084] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1404.388933] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1404.415204] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1404.459958] Lustre: lustre-MDT0000: new disk, initializing [ 1404.517188] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1404.531692] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1406.397176] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1411.846298] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1411.898302] Lustre: 87141:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1412.034291] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1413.811693] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1417.879931] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1419.483081] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1422.419074] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1422.557462] Lustre: 88880:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1425.022944] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1428.710625] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1429.009453] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1429.071948] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1430.585858] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1430.714294] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1432.474823] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1432.569164] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1434.084091] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1434.089797] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1434.098184] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1434.101699] Lustre: Skipped 5 previous similar messages [ 1435.565198] Lustre: server umount lustre-OST0000 complete [ 1443.359346] Lustre: server umount lustre-MDT0000 complete [ 1444.320412] LustreError: 87151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1444.328759] LustreError: 87151:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1444.895166] LustreError: 87133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422236 with bad export cookie 17494769948750680920 [ 1444.898205] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1444.900080] LustreError: 87133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1445.045670] Lustre: server umount lustre-MDT0001 complete [ 1448.601178] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 20:24:00 (1777422240) [ 1451.332790] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1453.277208] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1456.900484] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1458.740720] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1461.134383] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1462.846265] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1465.810783] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1468.092631] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1470.137965] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1471.721774] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1477.971663] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 6 sec [ 1479.536553] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1479.622769] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1482.252579] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1482.330621] Lustre: lustre-OST0001: new disk, initializing [ 1482.334204] Lustre: Skipped 2 previous similar messages [ 1482.337675] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1482.343921] Lustre: Skipped 3 previous similar messages [ 1482.347703] Lustre: 94180:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1484.561645] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1487.882937] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1489.300825] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1490.950988] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1490.954393] Lustre: Skipped 2 previous similar messages [ 1490.956720] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1490.984330] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1491.434477] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 1492.937291] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1493.021548] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1503.443985] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1511.442884] Lustre: Failing over lustre-MDT0000 [ 1511.820412] Lustre: server umount lustre-MDT0000 complete [ 1513.440199] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1513.443317] LustreError: Skipped 2 previous similar messages [ 1513.445145] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1513.449921] Lustre: Skipped 3 previous similar messages [ 1513.452694] LustreError: 91139:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1513.459181] LustreError: 91139:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1526.972057] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1526.973795] LDISKFS-fs (dm-0): recovery complete [ 1526.977039] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1527.022948] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1527.144962] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1528.401844] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1530.302044] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1530.302046] Lustre: 91851:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1532.384663] Lustre: 91850:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1532.388961] Lustre: 91850:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 1 previous similar message [ 1532.393272] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1532.414059] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1532.727122] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1533.041127] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1533.044218] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 1533.359121] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1533.362287] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 1533.681336] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1533.687690] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 8 previous similar messages [ 1534.322138] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1534.326296] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 3 previous similar messages [ 1534.639136] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1534.642898] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 3 previous similar messages [ 1535.895873] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1535.901087] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 6 previous similar messages [ 1536.528040] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1536.533173] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 1536.847200] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1536.850574] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 1539.985416] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1539.992389] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 12 previous similar messages [ 1540.625217] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1540.628410] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 1540.943136] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1540.946180] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 1548.137622] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1548.142100] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 25 previous similar messages [ 1548.769701] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1548.774277] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 25 previous similar messages [ 1549.087068] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1549.089708] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 25 previous similar messages [ 1564.385087] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1564.388933] Lustre: 96824:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 51 previous similar messages [ 1565.017646] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1565.021708] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 51 previous similar messages [ 1565.335100] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1565.337649] LustreError: 96824:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 51 previous similar messages [ 1590.015180] Lustre: 96824:0:(ldlm_lib.c:2377:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1590.019391] Lustre: 96824:0:(ldlm_lib.c:2387:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1590.023263] Lustre: 96824:0:(genops.c:1620:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client ef37a84b-bff0-44f9-bfd0-15388c31f7fe@192.168.204.56@tcp [ 1590.030172] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1590.033770] Lustre: 96824:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@000000003e65d523 x1863761860301568/t0(8589934781) o101->ef37a84b-bff0-44f9-bfd0-15388c31f7fe@192.168.204.56@tcp:637/0 lens 592/0 e 0 to 0 dl 1777422392 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1590.045982] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1590.050684] Lustre: lustre-MDT0000: Denying connection for new client ef37a84b-bff0-44f9-bfd0-15388c31f7fe (at 192.168.204.56@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1590.056193] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1590.074440] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1590.076403] Lustre: Skipped 2 previous similar messages [ 1590.078734] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1590.096509] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:80 to 0x280000401:577) [ 1590.096509] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:48 to 0x2c0000401:545) [ 1595.360578] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1595.363929] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1595.369738] Lustre: Skipped 3 previous similar messages [ 1595.372440] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1595.375222] Lustre: Skipped 3 previous similar messages [ 1596.033359] Lustre: server umount lustre-OST0000 complete [ 1598.945236] LustreError: 92734:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1598.950854] LustreError: 92734:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 19 previous similar messages [ 1603.414989] Lustre: server umount lustre-OST0001 complete [ 1610.846671] Lustre: server umount lustre-MDT0000 complete [ 1612.056173] LustreError: 91121:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422403 with bad export cookie 17494769948750732104 [ 1612.059145] LustreError: 91121:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1612.059213] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1612.173750] Lustre: server umount lustre-MDT0001 complete [ 1615.022235] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 20:26:46 (1777422406) [ 1617.457032] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1617.461549] Lustre: *** cfs_fail_loc=197, val=0*** [ 1632.927611] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1638.047352] LustreError: 98783:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.156@tcp: failed processing log, type 4: rc = -110 [ 1643.174921] Lustre: *** cfs_fail_loc=197, val=0*** [ 1643.176467] Lustre: Skipped 65 previous similar messages [ 1663.647293] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1663.652499] Lustre: Skipped 7 previous similar messages [ 1665.949687] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1667.995819] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1668.850189] Lustre: server umount lustre-OST0000 complete [ 1672.063560] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 20:27:43 (1777422463) [ 1686.091079] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1686.260531] LustreError: 100287:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1687.793742] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1691.244809] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1693.401776] LustreError: 100319:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1693.405650] LustreError: 100319:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1693.409032] LustreError: 100319:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -5 [ 1693.527642] Lustre: server umount lustre-MDT0000 complete [ 1705.478806] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 1708.919354] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1721.332922] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1721.427095] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1721.440284] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1721.477953] Lustre: lustre-MDT0000: new disk, initializing [ 1721.507730] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1722.919762] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1727.542108] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1727.594753] Lustre: 104338:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1727.704453] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1729.170322] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1732.670442] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1734.149215] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1736.877777] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1737.001565] Lustre: 106076:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1739.324310] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1742.908179] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1744.431044] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1744.580680] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1744.677562] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1746.174208] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1746.257809] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1749.474222] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1749.474815] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1749.477533] LustreError: Skipped 3 previous similar messages [ 1749.482544] Lustre: Skipped 5 previous similar messages [ 1749.486663] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1749.489942] Lustre: Skipped 7 previous similar messages [ 1753.039786] Lustre: server umount lustre-OST0000 complete [ 1760.472903] Lustre: server umount lustre-MDT0000 complete [ 1761.751212] LustreError: 106075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422553 with bad export cookie 17494769948750742793 [ 1761.754557] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1761.755762] LustreError: 106075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1761.877086] Lustre: server umount lustre-MDT0001 complete [ 1765.092761] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 20:29:16 (1777422556) [ 1768.297229] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 1769.415737] Key type lgssc unregistered [ 1769.550393] LNet: 108405:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1769.553498] LNetError: 108405:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1769.563128] LNet: Removed LNI 192.168.204.156@tcp [ 1769.885970] Key type .llcrypt unregistered [ 1769.887115] Key type ._llcrypt unregistered [ 1776.332226] Key type ._llcrypt registered [ 1776.333379] Key type .llcrypt registered [ 1776.370238] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 1782.938352] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1783.295063] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1783.348110] alg: No test for adler32 (adler32-zlib) [ 1784.209331] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 1784.307665] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 1785.895153] Key type lgssc registered [ 1786.355579] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1800.662857] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1800.673149] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1801.771890] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1801.784780] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1801.825159] Lustre: lustre-MDT0000: new disk, initializing [ 1801.855046] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1801.862684] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1803.274167] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1807.971470] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1808.091577] Lustre: lustre-OST0000: new disk, initializing [ 1808.095242] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1808.097543] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 1808.097776] Lustre: Skipped 1 previous similar message [ 1808.103157] Lustre: 112502:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1808.133520] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1810.330879] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1813.492416] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1813.497187] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1813.510171] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1815.060202] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1815.135258] Lustre: lustre-OST0001: new disk, initializing [ 1815.137951] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1815.142686] Lustre: 113347:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1815.176348] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1817.239613] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1817.246688] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1817.262394] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1817.614872] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1822.688394] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1822.688958] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1822.693812] Lustre: Skipped 1 previous similar message [ 1827.811805] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1827.815285] Lustre: Skipped 2 previous similar messages [ 1828.615969] Lustre: server umount lustre-MDT0000 complete [ 1831.434288] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 1833.549178] LustreError: 111703:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422625 with bad export cookie 13887415551849093681 [ 1833.551373] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1833.554986] LustreError: 111703:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1833.608710] Lustre: server umount lustre-OST0000 complete [ 1835.316701] Lustre: server umount lustre-OST0001 complete [ 1839.187725] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 20:30:30 (1777422630) [ 1843.362636] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1853.090560] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 20:30:44 (1777422644) [ 1868.805112] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 1872.759292] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 1888.827092] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1888.941188] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1888.957067] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1889.001589] Lustre: lustre-MDT0000: new disk, initializing [ 1889.032750] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1889.042217] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1890.827833] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1895.643029] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1895.691037] Lustre: 120020:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1895.721917] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1895.724691] Lustre: Skipped 1 previous similar message [ 1895.767204] Lustre: lustre-MDT0001: new disk, initializing [ 1895.806251] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1895.824900] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1895.831450] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1897.407330] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1900.940678] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1902.534797] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1905.659828] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1905.856506] Lustre: lustre-OST0000: new disk, initializing [ 1905.860581] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1905.864929] Lustre: 121761:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1905.901471] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1908.430173] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1908.679107] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1908.683952] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1908.738556] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1912.193754] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1914.066555] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1914.177070] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1915.958735] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1916.065267] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1918.948694] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1918.950876] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1918.952936] LustreError: Skipped 1 previous similar message [ 1918.961815] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1918.966211] Lustre: Skipped 1 previous similar message [ 1924.071695] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1924.075058] Lustre: Skipped 1 previous similar message [ 1931.231283] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1931.297993] Lustre: server umount lustre-OST0000 complete [ 1934.305587] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1934.306749] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1934.310612] Lustre: Skipped 2 previous similar messages [ 1934.312873] Lustre: Skipped 2 previous similar messages [ 1938.775914] Lustre: server umount lustre-MDT0000 complete [ 1940.149401] LustreError: 120011:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422731 with bad export cookie 13887415551849094892 [ 1940.154679] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1940.156576] LustreError: 120011:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1940.289519] Lustre: server umount lustre-MDT0001 complete [ 1943.356267] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 20:32:14 (1777422734) [ 1945.884785] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1946.084754] LustreError: 124026:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1946.093843] LustreError: 124026:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1946.121529] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1947.707626] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1951.012888] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1952.694134] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1954.723686] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1956.023576] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1958.502436] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1960.760827] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 1962.811853] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1975.348652] Lustre: *** cfs_fail_loc=159, val=0*** [ 1975.350886] Lustre: Skipped 1 previous similar message [ 1991.634610] Lustre: lustre-MDT0000: Client c6dbebab-b73f-4457-827e-3e86deb453d2 (at 192.168.204.56@tcp) reconnecting [ 1992.272438] Lustre: *** cfs_fail_loc=159, val=0*** [ 1992.273871] Lustre: Skipped 3 previous similar messages [ 2008.529481] Lustre: lustre-MDT0000: Client c6dbebab-b73f-4457-827e-3e86deb453d2 (at 192.168.204.56@tcp) reconnecting [ 2027.490836] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2027.492275] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2027.495378] LustreError: Skipped 1 previous similar message [ 2027.501727] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2027.505148] Lustre: Skipped 1 previous similar message [ 2029.590161] Lustre: server umount lustre-OST0000 complete [ 2032.609315] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2032.614160] Lustre: Skipped 1 previous similar message [ 2037.142225] Lustre: server umount lustre-MDT0000 complete [ 2037.727947] LustreError: 124025:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2037.733805] LustreError: 124025:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2038.469190] LustreError: 124005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777422829 with bad export cookie 13887415551849095760 [ 2038.472500] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2038.474295] LustreError: 124005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2038.587484] Lustre: server umount lustre-MDT0001 complete [ 2042.117526] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2043.213201] Key type lgssc unregistered [ 2043.352419] LNet: 127467:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2043.356868] LNetError: 127467:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2043.369328] LNet: Removed LNI 192.168.204.156@tcp [ 2043.696898] Key type .llcrypt unregistered [ 2043.698554] Key type ._llcrypt unregistered [ 2052.845268] Key type ._llcrypt registered [ 2052.846370] Key type .llcrypt registered [ 2052.883745] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2053.306993] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2053.319197] alg: No test for adler32 (adler32-zlib) [ 2054.178766] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2054.262838] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2055.847140] Key type lgssc registered [ 2056.229991] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2058.975940] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2058.983964] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2060.163585] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2061.568147] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2064.746039] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2064.893549] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2066.320596] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2068.165956] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2069.355690] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2071.634172] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2071.767415] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2073.697122] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2075.638235] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2086.122062] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2090.995652] Lustre: *** cfs_fail_loc=159, val=0*** [ 2107.340573] Lustre: lustre-MDT0000: Client fdf9ea45-b556-436b-aad3-436eafbe43e9 (at 192.168.204.56@tcp) reconnecting [ 2108.095797] Lustre: *** cfs_fail_loc=159, val=0*** [ 2124.234499] Lustre: lustre-MDT0001: Client fdf9ea45-b556-436b-aad3-436eafbe43e9 (at 192.168.204.56@tcp) reconnecting [ 2124.722551] Lustre: *** cfs_fail_loc=159, val=0*** [ 2124.724840] Lustre: Skipped 3 previous similar messages [ 2140.107156] Lustre: lustre-MDT0001: Client fdf9ea45-b556-436b-aad3-436eafbe43e9 (at 192.168.204.56@tcp) reconnecting [ 2155.696376] Lustre: 131586:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2156.576121] Lustre: *** cfs_fail_loc=159, val=0*** [ 2156.577997] Lustre: Skipped 5 previous similar messages [ 2171.840974] Lustre: lustre-MDT0000: Client 2b9b2b66-7098-4d33-9fe7-dd2af0f18d2b (at 192.168.204.56@tcp) reconnecting [ 2172.429680] Lustre: *** cfs_fail_loc=159, val=0*** [ 2172.431284] Lustre: Skipped 13 previous similar messages [ 2188.751315] Lustre: lustre-MDT0000: Client 2b9b2b66-7098-4d33-9fe7-dd2af0f18d2b (at 192.168.204.56@tcp) reconnecting [ 2189.347317] Lustre: 131879:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2208.224347] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2208.227831] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2208.234491] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2209.249441] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2209.250789] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2209.250839] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2209.251653] Lustre: Skipped 1 previous similar message [ 2212.310360] Lustre: server umount lustre-OST0000 complete [ 2214.368853] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2214.369632] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2214.373589] Lustre: Skipped 1 previous similar message [ 2219.487967] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2219.490165] Lustre: Skipped 2 previous similar messages [ 2219.797512] Lustre: server umount lustre-MDT0000 complete [ 2221.046177] LustreError: 131709:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777423012 with bad export cookie 14957542464642634842 [ 2221.049502] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2221.051929] LustreError: 131709:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2221.176665] Lustre: server umount lustre-MDT0001 complete [ 2224.677040] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2225.625022] Key type lgssc unregistered [ 2225.739341] LNet: 132937:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2225.741639] LNetError: 132937:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2225.749308] LNet: Removed LNI 192.168.204.156@tcp [ 2226.016764] Key type .llcrypt unregistered [ 2226.018095] Key type ._llcrypt unregistered [ 2234.503240] Key type ._llcrypt registered [ 2234.504155] Key type .llcrypt registered [ 2234.542835] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2234.867667] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2234.906892] alg: No test for adler32 (adler32-zlib) [ 2235.751316] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2235.831765] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2237.415113] Key type lgssc registered [ 2237.770541] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2240.274817] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2240.280966] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2241.427887] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2242.694891] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2245.509169] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2245.623391] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2246.821433] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2248.532525] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2249.651791] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2251.834615] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2251.979491] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2253.911863] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2255.709773] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2256.101607] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2266.341840] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2273.380513] Lustre: 136581:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2274.053522] Lustre: 136629:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2274.516365] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2275.684544] Lustre: 136777:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2275.995520] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2275.998647] Lustre: Skipped 1 previous similar message [ 2276.308052] Lustre: 136875:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2281.953576] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2281.954479] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2281.954812] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2281.960943] Lustre: Skipped 1 previous similar message [ 2281.964038] LustreError: Skipped 1 previous similar message [ 2283.341111] Lustre: server umount lustre-OST0000 complete [ 2286.559961] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2286.562563] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2286.567398] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2286.569673] Lustre: Skipped 1 previous similar message [ 2290.720708] Lustre: server umount lustre-MDT0000 complete [ 2291.894466] LustreError: 134294:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777423083 with bad export cookie 3586981501236567158 [ 2291.897529] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2291.899190] LustreError: 134294:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2292.003629] Lustre: server umount lustre-MDT0001 complete [ 2295.370294] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2296.386793] Key type lgssc unregistered [ 2296.516416] LNet: 137913:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2296.519841] LNetError: 137913:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2296.528631] LNet: Removed LNI 192.168.204.156@tcp [ 2296.814176] Key type .llcrypt unregistered [ 2296.815601] Key type ._llcrypt unregistered [ 2305.800242] Key type ._llcrypt registered [ 2305.801910] Key type .llcrypt registered [ 2305.838916] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2306.133791] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2306.173095] alg: No test for adler32 (adler32-zlib) [ 2307.025544] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2307.109335] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2308.695156] Key type lgssc registered [ 2309.049221] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2311.674241] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2311.681734] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2312.848826] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2314.086438] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2316.956272] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2317.139895] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2318.555473] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2320.516273] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2321.744571] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2324.148625] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2324.272672] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2326.282675] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2327.334685] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 2328.115549] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2337.573730] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 2340.813227] Lustre: *** cfs_fail_loc=159, val=0*** [ 2357.182724] Lustre: lustre-MDT0000: Client 31fe5e1c-e89e-4292-b836-b62edb708b29 (at 192.168.204.56@tcp) reconnecting [ 2373.601420] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2373.604771] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2373.609778] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2373.612486] Lustre: Skipped 1 previous similar message [ 2378.123215] Lustre: server umount lustre-OST0000 complete [ 2383.840993] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2383.841662] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2383.842261] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2383.845762] Lustre: Skipped 2 previous similar messages [ 2383.848977] LustreError: Skipped 1 previous similar message [ 2385.427274] Lustre: server umount lustre-MDT0000 complete [ 2386.562088] LustreError: 139269:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777423178 with bad export cookie 14898554819994535281 [ 2386.563989] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2386.565037] LustreError: 139269:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2386.669314] Lustre: server umount lustre-MDT0001 complete [ 2390.050354] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2391.069267] Key type lgssc unregistered [ 2391.202378] LNet: 142623:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2391.205354] LNetError: 142623:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2391.214282] LNet: Removed LNI 192.168.204.156@tcp [ 2391.536157] Key type .llcrypt unregistered [ 2391.537362] Key type ._llcrypt unregistered [ 2400.497453] Key type ._llcrypt registered [ 2400.498945] Key type .llcrypt registered [ 2400.539362] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2400.950717] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2400.958976] alg: No test for adler32 (adler32-zlib) [ 2401.815182] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2401.899159] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2403.479133] Key type lgssc registered [ 2403.837916] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2406.355586] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2406.362186] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2407.518109] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2408.856801] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2412.135191] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2412.343842] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2414.028800] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2417.628780] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2420.421338] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2424.959868] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2425.218756] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2429.696267] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2432.377112] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2433.734824] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2437.488350] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2457.510471] Lustre: lustre-OST0000: evicting d789be41-4bbf-4879-a8df-be9e834040ef (at 192.168.204.56@tcp) by administrative request [ 2457.510471] Lustre: lustre-MDT0001: evicting d789be41-4bbf-4879-a8df-be9e834040ef (at 192.168.204.56@tcp) by administrative request [ 2483.684688] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2483.684820] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2483.689265] LustreError: Skipped 1 previous similar message [ 2483.701713] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2483.705847] Lustre: Skipped 1 previous similar message [ 2488.762680] Lustre: server umount lustre-OST0000 complete [ 2493.922370] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2493.928709] Lustre: Skipped 1 previous similar message [ 2493.931801] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2493.934374] Lustre: Skipped 1 previous similar message [ 2496.694546] Lustre: server umount lustre-MDT0000 complete [ 2498.475547] LustreError: 146974:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777423289 with bad export cookie 7391154086822443120 [ 2498.481163] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2498.482033] LustreError: 146974:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2498.640341] Lustre: server umount lustre-MDT0001 complete [ 2503.122810] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2504.408577] Key type lgssc unregistered [ 2504.558594] LNet: 147707:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2504.563502] LNetError: 147707:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2504.572398] LNet: Removed LNI 192.168.204.156@tcp [ 2504.943620] Key type .llcrypt unregistered [ 2504.945509] Key type ._llcrypt unregistered [ 2537.568842] Key type ._llcrypt registered [ 2537.570510] Key type .llcrypt registered [ 2537.623799] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2538.136473] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2538.152734] alg: No test for adler32 (adler32-zlib) [ 2539.048947] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2539.155889] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2540.767341] Key type lgssc registered [ 2541.318836] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2544.964549] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2544.975271] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2546.222204] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2548.071888] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2551.779801] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2551.961654] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2553.895353] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2556.274118] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2557.839371] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2560.895145] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2561.121030] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2562.153946] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 2564.026341] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2566.638490] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2571.368759] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 2576.865537] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2576.865608] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2576.871706] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2576.881658] Lustre: Skipped 1 previous similar message [ 2576.886887] Lustre: Skipped 1 previous similar message [ 2577.248797] Lustre: server umount lustre-OST0000 complete [ 2581.254558] Lustre: server umount lustre-MDT0000 complete [ 2581.985809] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2581.986550] LustreError: 150885:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2581.992549] Lustre: Skipped 1 previous similar message [ 2582.006546] LustreError: 150885:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2583.061251] LustreError: 150879:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777423374 with bad export cookie 6922847884029111422 [ 2583.063434] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2583.069625] LustreError: 150879:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2583.207243] Lustre: server umount lustre-MDT0001 complete [ 2587.785186] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2589.117895] Key type lgssc unregistered [ 2589.256659] LNet: 153343:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2589.262388] LNetError: 153343:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2589.272636] LNet: Removed LNI 192.168.204.156@tcp [ 2589.631720] Key type .llcrypt unregistered [ 2589.633329] Key type ._llcrypt unregistered [ 2600.789723] Key type ._llcrypt registered [ 2600.791279] Key type .llcrypt registered [ 2600.848643] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2601.338538] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2601.348557] alg: No test for adler32 (adler32-zlib) [ 2602.270719] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2602.387167] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2603.991443] Key type lgssc registered [ 2604.479576] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2610.999660] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 20:43:22 (1777423402) [ 2618.061226] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 2622.259384] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2639.073267] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2639.085279] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2640.225610] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2640.243613] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2640.290579] Lustre: lustre-MDT0000: new disk, initializing [ 2640.336449] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2640.346278] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2642.148072] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2647.771838] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2647.833663] Lustre: 157527:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2647.870825] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2647.874854] Lustre: Skipped 1 previous similar message [ 2647.923635] Lustre: lustre-MDT0001: new disk, initializing [ 2647.978838] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2647.996345] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2648.004835] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2649.934848] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2654.037560] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2655.744661] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2659.478806] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2659.627046] Lustre: lustre-OST0000: new disk, initializing [ 2659.630644] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2659.636840] Lustre: 159270:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2659.684672] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2662.438976] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2664.451130] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2664.455218] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2664.501752] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2666.134458] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2674.657666] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2674.657992] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2674.660904] LustreError: Skipped 1 previous similar message [ 2674.668088] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2674.674863] Lustre: Skipped 1 previous similar message [ 2676.456456] Lustre: server umount lustre-OST0000 complete [ 2678.752428] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2678.756989] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2678.763228] Lustre: Skipped 1 previous similar message [ 2678.768639] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2679.777260] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2679.783055] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2679.787263] Lustre: Skipped 1 previous similar message [ 2684.597463] Lustre: server umount lustre-MDT0000 complete [ 2686.441515] LustreError: 157519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777423477 with bad export cookie 17470708747674313164 [ 2686.445045] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2686.448777] LustreError: 157519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2686.627976] Lustre: server umount lustre-MDT0001 complete [ 2691.355703] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 2692.646566] Key type lgssc unregistered [ 2692.786618] LNet: 161043:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2692.790520] LNetError: 161043:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2692.804342] LNet: Removed LNI 192.168.204.156@tcp [ 2693.218994] Key type .llcrypt unregistered [ 2693.221143] Key type ._llcrypt unregistered [ 2704.546523] Key type ._llcrypt registered [ 2704.550254] Key type .llcrypt registered [ 2704.600413] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 2705.041232] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2705.070089] alg: No test for adler32 (adler32-zlib) [ 2705.948069] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 2706.054591] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 2707.648124] Key type lgssc registered [ 2708.163301] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2711.543553] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2711.557884] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2712.775612] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2714.534743] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2718.347201] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2718.539430] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2720.106360] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2722.354122] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2723.807907] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2726.683424] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2726.880984] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2729.525301] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 2731.939421] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2738.155846] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 2745.435966] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2745.446030] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2745.452248] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2745.456496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2745.460500] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2745.851676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.324556] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2746.328669] Lustre: Skipped 1 previous similar message [ 2746.337347] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2746.344842] Lustre: Skipped 1 previous similar message [ 2746.348679] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2746.351915] Lustre: Skipped 1 previous similar message [ 2746.354068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.363728] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2746.366526] Lustre: Skipped 1 previous similar message [ 2746.779230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.186584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.634921] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2747.640256] Lustre: Skipped 2 previous similar messages [ 2747.650529] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2747.659271] Lustre: Skipped 2 previous similar messages [ 2747.662202] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2747.667843] Lustre: Skipped 2 previous similar messages [ 2747.669851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.676959] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2747.683889] Lustre: Skipped 2 previous similar messages [ 2748.071919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.454041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.826388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.207770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.631202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.013968] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2750.017418] Lustre: Skipped 5 previous similar messages [ 2750.025242] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2750.030988] Lustre: Skipped 5 previous similar messages [ 2750.033315] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2750.036751] Lustre: Skipped 5 previous similar messages [ 2750.038983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.043538] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2750.047375] Lustre: Skipped 5 previous similar messages [ 2750.399370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.780158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.201677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.593211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.958791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2752.344186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2752.721311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.120992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.541239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.960537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2754.390943] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2754.395060] Lustre: Skipped 10 previous similar messages [ 2754.404686] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2754.413776] Lustre: Skipped 10 previous similar messages [ 2754.418347] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2754.422679] Lustre: Skipped 10 previous similar messages [ 2754.425097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2754.435241] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2754.438905] Lustre: Skipped 10 previous similar messages [ 2754.836106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.227936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.623072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.043930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.511478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.911627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.346361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.766790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.181841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.571889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.947281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.375534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.829203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.274959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.659632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.073555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.475736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.892352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.302200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.730584] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2762.733654] Lustre: Skipped 19 previous similar messages [ 2762.742034] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2762.749207] Lustre: Skipped 19 previous similar messages [ 2762.752365] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2762.754907] Lustre: Skipped 19 previous similar messages [ 2762.757352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.763462] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2762.766508] Lustre: Skipped 19 previous similar messages [ 2763.228778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2763.692336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.146269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.632997] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.103348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.542503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.950412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.406646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.825068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.248684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.655173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.083213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.499093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.895241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.322283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.731364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.144425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.598778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.015557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.445067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.850218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.280544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.724966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.149743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.558895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.994190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.424047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.828980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.271645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.740807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.140374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.548176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.936346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.381467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.803530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.233861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.660301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.149727] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2779.155853] Lustre: Skipped 37 previous similar messages [ 2779.163955] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2779.172247] Lustre: Skipped 37 previous similar messages [ 2779.175277] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2779.178246] Lustre: Skipped 37 previous similar messages [ 2779.180819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.186484] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2779.189097] Lustre: Skipped 37 previous similar messages [ 2779.642540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.082249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.520687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.926178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.379362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.802097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.201671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.607269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.051822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.477930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.905188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.339625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.744973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.158886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.573305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.949293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.324366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.731681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.102317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.534286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.988649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.412549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.822560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.222321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.592305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.995089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.363438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.719208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.148513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.563381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.962636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.346356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.784209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.192071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.585712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.015113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.417026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.831742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.244062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.672556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.066337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.504089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.963789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.363994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.784417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.172173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.587177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.980089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.388319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.792792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.198180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.602471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.015918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.506912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.927959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.367437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.821870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.212328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.596015] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.977561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.363854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.750640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.185302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.587635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.997973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.410700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.826676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.286328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.695777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.102802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.521630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.952587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.369298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.781798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.214989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.629436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.074318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.521284] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2811.525465] Lustre: Skipped 77 previous similar messages [ 2811.533559] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2811.541639] Lustre: Skipped 77 previous similar messages [ 2811.547239] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2811.549925] Lustre: Skipped 77 previous similar messages [ 2811.554756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.563108] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2811.566064] Lustre: Skipped 77 previous similar messages [ 2811.958684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.380207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.800761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.221952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.614338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.037757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.427914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.810463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.205640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.552072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.948232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.323910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.696492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.075598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.471358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.893153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.323213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.746174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.146187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.550225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.952301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2820.341877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2820.732614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.112595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.508948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.893272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.290374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.680857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.068810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.491959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.873495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.277224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.672205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.125907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.549654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.969622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.383447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.805240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.268237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.709191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.140354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.612694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.031795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.474742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.901823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2830.322491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2830.753295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.186532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.634764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.063418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.487322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.907976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2833.300169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2833.700589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.097406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.525402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.963448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.352515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.776089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2836.183964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2836.615450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.049046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.491628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.962175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.405823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.822286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2839.233176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2839.685360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2840.121465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2840.601961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.048380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.517167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.935043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.377901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.805740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2843.280648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2843.719533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2844.172212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2844.588965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2845.038929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2845.500510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.004358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.402509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.804763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2847.222564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2847.673227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.106568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.532542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.952444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2849.412348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2849.808990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.289271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.677812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2851.077088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2851.479942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2851.863930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.256776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.643987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.054797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.461185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.838712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.240104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.615633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.013259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.403843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.782553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.162014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.536266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.910720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.300697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.721289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.158823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.539599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.942963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.338147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.729584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.126356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.556185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.954189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.330829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.723423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.164774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.601153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.990912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.410429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.785401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.154319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.543099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.950969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2865.370972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2865.778871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.191371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.592103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.943609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2867.321492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2867.666237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.031618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.396369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.755966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.133202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.530640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.934891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.356567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.789850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.184680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.611593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.030327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.446058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.829400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.249327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.697676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.106489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.512425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.913831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.327979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.762581] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2875.765806] Lustre: Skipped 155 previous similar messages [ 2875.773578] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2875.782357] Lustre: Skipped 155 previous similar messages [ 2875.785024] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2875.787474] Lustre: Skipped 155 previous similar messages [ 2875.789681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.794490] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2875.796947] Lustre: Skipped 155 previous similar messages [ 2876.177466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2876.607803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.032564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.470908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.880593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.296119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.660069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.034050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.423443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.810758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.185437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.602507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.006253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.371072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.764271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.162300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.554249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.007930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.440390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.870157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.299238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.723890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.116063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.517929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.922699] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2885.930037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.930068] LustreError: 162449:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2886.391616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2886.875730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.294617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.705564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.111617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.528572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.980100] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2888.986697] LustreError: 162449:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2888.990901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.437485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.872164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2890.317296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2890.752911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.238728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.667928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.111894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.618343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.062820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.484232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.946300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.378400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.806082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.264178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.734138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.161425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.593992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.025207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.438848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.851801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.238162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.626488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.008264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.420582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.796096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.203571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.625342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.040313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.439257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.847484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.297278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.668182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.068278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.472290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.867275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.278037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.653845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.060678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.452866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.855472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.235117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.620649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.976450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.395953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.789684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.165841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.558539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.960307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.348483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.733984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.154170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.593058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.011382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.441220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.881845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.344732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.757490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.158728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.581675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.023658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.395919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.811349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.246171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.659321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.051296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.459436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.867477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.287128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.724109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.153467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.574539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.004806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.449896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.876441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.331290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.744567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.123658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.519521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.906677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.379717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.813456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.197118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.618236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.093405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.558873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.005621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.471451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.912252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.364915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.791890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.238294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.665152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.129468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.571159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.022755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.495118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.944442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.367267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.827735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.257212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.685511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.123710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.529212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.980403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.450272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.844993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.249942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.661502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.062615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.468946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.866248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.272868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.647512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.049685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.434408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.829378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.233191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.599492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.973954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.365322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.745231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.120109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.528711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.955360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.369930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.789215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.219459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.625787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.068176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.470271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.857724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.260551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.692363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.117293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.535054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.951492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.357501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.743084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.139657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.541750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.944930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.373920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.782125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.205394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.626451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.051260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.488156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.946959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.373546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.811269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.302991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.730481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.162960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.565586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.947186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.352104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.766548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.173690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.596372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.021708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.436852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.858538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.288686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.727021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.143834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.529677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.926772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.363291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.818330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2960.260832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2960.698940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2961.133069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2961.547183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2961.994531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2962.417305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2962.879547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2963.355452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2963.793597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2964.221949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2964.625293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2965.038486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2965.460899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2965.945501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2966.389656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2966.858509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2967.318300] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2967.323475] LustreError: 162449:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2967.330786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2967.759679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2968.182133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2968.623987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2969.088470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2969.507963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2969.923966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2970.343141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2970.756303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2971.179047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2971.555262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2971.936063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2972.337065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2972.727636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2973.107519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2973.517584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2973.887121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2974.246778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2974.633264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2974.997529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2975.376358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2975.790677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2976.191404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2976.629583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2977.056679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2977.443206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2977.838152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2978.275643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2978.717904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2979.111402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2979.508726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2979.936889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2980.339902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2980.797800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2981.297738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2981.719935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2982.152941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2982.571937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2983.060784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2983.548465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2984.007487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2984.462230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2984.885961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2985.293975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2985.730708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2986.179628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2986.649568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2987.029360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2987.441908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2987.853726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2988.235648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2988.636392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2989.048921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2989.422301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2989.824853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2990.242497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2990.643898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2991.062222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2991.493041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2991.917204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2992.311755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2992.717219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2993.073974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2993.468181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2993.870868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2994.260683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2994.661386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2995.140861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2995.571613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2995.988688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2996.400692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2996.866343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2997.290173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2997.699443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2998.111439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2998.547098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2998.995603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2999.387064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2999.802882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3000.247901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3000.662366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3001.106693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3001.553103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3001.950356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3002.379348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3002.810725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3003.222204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3003.622828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3004.023148] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3004.026673] Lustre: Skipped 305 previous similar messages [ 3004.033992] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3004.039715] Lustre: Skipped 305 previous similar messages [ 3004.042792] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3004.048133] Lustre: Skipped 305 previous similar messages [ 3004.050435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3004.057261] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3004.060952] Lustre: Skipped 305 previous similar messages [ 3004.437195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3004.811923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3005.220077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3005.615433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3006.047654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3006.457992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3006.884860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3007.319536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3007.751968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3008.181044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3008.572313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3009.008349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3009.404577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3009.791800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3010.190761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3010.591755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3010.981569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3011.383656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3011.771904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3012.198290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3012.565986] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3012.572381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3012.573827] LustreError: 162449:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3012.956727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3013.353543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3013.792377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3014.209136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3014.578354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3015.002288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3015.473984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3015.914119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3016.338197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3016.763388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3017.174830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3017.536627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3017.930656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3018.326173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3018.765604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3019.174132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3019.573469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3019.971699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3020.382734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3020.778927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3021.180959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3021.579379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3021.985903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3022.384997] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3022.755921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3023.131138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3023.519965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3023.919348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3024.314403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3024.743311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3025.145472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3025.550975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3025.945278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3026.373261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3026.840252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3027.280342] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3027.285262] LustreError: 162449:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3027.287579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3027.733101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3028.159560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3028.611858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3029.046606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3029.460459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3029.861320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3030.295216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3030.676962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3031.076478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3031.466425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3031.855368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3032.252531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3032.644132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3033.049289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3033.447047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3033.849619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3034.236747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3034.621939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3035.035989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3035.434947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3035.818969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3036.205519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3036.600976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3036.968556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3037.335052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3037.707795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3038.076929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3038.433338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3038.804271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3039.175667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3039.545129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3039.917395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3040.305368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3040.700070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3041.083736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3041.454941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3041.848565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3042.240298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3042.595914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3042.973711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3043.384426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3043.785437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3044.200598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3044.602912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3044.991727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3045.379204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3045.801333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3046.180724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3046.564137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3046.981682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3047.359133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3047.742410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3048.147656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3048.536412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3048.941547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3049.343239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3049.757800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3050.142564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3050.551723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3050.961589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3051.369348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3051.765800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3052.167105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3052.563034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3052.957531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3053.346158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3053.732585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3054.114257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3054.484955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3054.886927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3055.264472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3055.657217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3056.055037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3056.448437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3056.842373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3057.254990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3057.663129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3058.032794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3058.414693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3058.812715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3059.207597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3059.614845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3060.040316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3060.455535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3060.878862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3061.279402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3061.654246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3062.032267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3062.409033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3062.778156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3063.132546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3063.484598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3063.877875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3064.242332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3064.595936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3064.962502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3065.335095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3065.730479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3066.121816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3066.496129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3066.860157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3067.223273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3067.608579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3068.004205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3068.369145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3068.786570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3069.210853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3069.637697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3070.051127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3070.439131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3070.829692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3071.223740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3071.647658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3072.042459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3072.436242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3072.837226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3073.226734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3073.617967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3074.034353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3074.441948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3074.847667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3075.253997] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3075.668139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3076.074221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3076.492447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3076.907349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3077.319367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3077.758816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3078.172599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3078.573747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3079.001915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3079.468792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3079.921374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3080.354821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3080.741771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3081.134649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3081.554196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3081.925935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3082.301304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3082.677264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3083.062185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3083.445785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3083.864896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3084.251393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3084.608815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3084.995913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3085.375433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3085.743411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3086.138628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3086.523581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3086.901680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3087.294541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3087.684885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3088.064596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3088.450815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3088.817516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3089.203425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3089.595266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3089.977446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3090.349364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3090.710559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3091.117553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3091.494451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3091.859222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3092.236635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3092.602306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3092.996834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3093.354639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3093.775445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3094.132949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3094.499812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3094.869131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3095.234222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3095.578962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3095.916562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3096.271187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3096.629493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3096.970885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3097.309777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3097.668075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3098.041373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3098.399257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3098.766861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3099.116283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3099.466287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3099.817779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3100.157204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3100.500482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3100.842262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3101.196181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3101.553046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3101.888392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3102.256917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3102.604137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3102.970269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3103.330658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3103.712172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3104.076208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3104.425625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3104.800905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3105.182246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3105.539585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3105.942259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3106.341864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3106.753924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3107.161126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3107.562942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3107.967496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3108.387095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3108.766250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3109.137949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3109.532428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3109.932418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3110.311742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3110.697102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3111.055589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3111.451430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3111.832115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3112.205303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3112.560529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3112.943980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3113.323488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3113.759907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3114.144954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3114.508723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3114.900845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3115.300853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3115.706840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3116.113505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3116.518395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3116.930797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3117.325287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3117.731736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3118.114438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3118.510487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3118.920476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3119.309514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3119.704846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3120.083275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3120.467425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3120.833970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3121.222664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3121.578090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3121.937381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3122.291742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3122.655290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3123.014522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3123.388977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3123.786842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3124.210644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3124.580156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3124.934377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3125.324889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3125.716099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3126.087453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3126.476873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3126.911805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3127.317735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3127.688296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3128.099825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3128.498722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3128.894571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3129.344968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3129.741486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3130.172208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3130.641876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3131.040927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3131.433479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3131.853172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3132.264337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3132.670636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3133.121837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3133.543305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3133.964378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3134.388892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3134.788732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3135.192701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3135.616997] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3136.020040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3136.416877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3136.826665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3137.237577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3137.667610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3138.101079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3138.520680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3138.925358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3139.337558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3139.735107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3140.147369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3140.591779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3140.998808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3141.459970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3141.875424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3142.278556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3142.665715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3143.062215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3143.453764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3143.841414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3144.261859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3144.642902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3145.068694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3145.484142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3145.880987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3146.286988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3146.755862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3147.159493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3147.574750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3148.016847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3148.416926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3148.798495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3149.198178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3149.599102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3150.045600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3150.485366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3150.906417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3151.332462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3151.808445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3152.214472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3152.647200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3153.083570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3153.500636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3153.887371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3367.604763] LustreError: 164020:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 3367.610829] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 3367.614832] LustreError: 162449:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 1 previous similar message [ 3474.401621] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3474.402471] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3474.406227] Lustre: Skipped 380 previous similar messages [ 3479.152093] Lustre: server umount lustre-OST0000 complete [ 3481.567982] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3481.573023] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3481.575498] Lustre: Skipped 1 previous similar message [ 3484.640066] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3484.642935] Lustre: Skipped 1 previous similar message [ 3486.664607] Lustre: server umount lustre-MDT0000 complete [ 3487.915047] LustreError: 216418:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424279 with bad export cookie 9309233308972938421 [ 3487.918588] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3487.919590] LustreError: 216418:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3488.030564] Lustre: server umount lustre-MDT0001 complete [ 3491.571889] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 3492.627392] Key type lgssc unregistered [ 3492.756402] LNet: 217152:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3492.759755] LNetError: 217152:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3492.768401] LNet: Removed LNI 192.168.204.156@tcp [ 3493.095433] Key type .llcrypt unregistered [ 3493.096957] Key type ._llcrypt unregistered [ 3502.484290] Key type ._llcrypt registered [ 3502.485336] Key type .llcrypt registered [ 3502.524812] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 3502.970285] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3502.979479] alg: No test for adler32 (adler32-zlib) [ 3503.842805] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 3503.935056] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 3505.527230] Key type lgssc registered [ 3505.929411] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3508.738498] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3508.748173] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3509.955762] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3511.430210] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3514.712683] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3514.884506] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3516.304819] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3518.295347] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3519.567989] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3522.129527] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3522.269811] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3524.343052] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3526.262428] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3535.592906] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 3538.812586] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3539.459391] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3539.466318] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3539.470689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.477301] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3539.477361] LustreError: 218548:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 3540.961033] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3540.963439] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3540.967909] Lustre: Skipped 1 previous similar message [ 3540.968652] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3540.970938] Lustre: Skipped 1 previous similar message [ 3541.956823] Lustre: lustre-OST0000: Not available for connect from 192.168.204.56@tcp (stopping) [ 3542.227333] Lustre: server umount lustre-OST0000 complete [ 3559.559160] LustreError: 218548:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 3570.472949] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3570.599953] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3572.609361] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3574.375447] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3580.835925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.841297] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3580.842175] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.117355] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 8 sec [ 3584.393327] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9e52875d9800.ost_server_uuid 50 [ 3584.961635] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9e52875d9800.ost_server_uuid in FULL state after 0 sec [ 3586.018211] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3586.018460] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3586.026965] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3586.030261] Lustre: Skipped 1 previous similar message [ 3591.137296] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3591.141339] Lustre: Skipped 1 previous similar message [ 3592.082724] Lustre: server umount lustre-OST0000 complete [ 3596.256758] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3596.263158] Lustre: Skipped 1 previous similar message [ 3596.266059] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3596.268794] Lustre: Skipped 1 previous similar message [ 3599.585479] Lustre: server umount lustre-MDT0000 complete [ 3601.019627] LustreError: 220946:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424392 with bad export cookie 3948866109272276074 [ 3601.023116] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3601.024293] LustreError: 220946:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3601.150249] Lustre: server umount lustre-MDT0001 complete [ 3604.904310] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 3605.978451] Key type lgssc unregistered [ 3606.115739] LNet: 223201:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3606.120258] LNetError: 223201:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3606.129312] LNet: Removed LNI 192.168.204.156@tcp [ 3606.439098] Key type .llcrypt unregistered [ 3606.440545] Key type ._llcrypt unregistered [ 3618.561548] Key type ._llcrypt registered [ 3618.563205] Key type .llcrypt registered [ 3618.612184] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 3618.969477] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3619.029886] alg: No test for adler32 (adler32-zlib) [ 3619.908159] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 3620.017100] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 3621.615234] Key type lgssc registered [ 3622.046837] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3625.671907] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3625.684233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3626.922077] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3628.375542] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3631.474880] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3631.619846] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3633.016518] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3634.091796] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 3636.564932] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3636.724379] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3637.740161] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 3639.107852] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3642.149865] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3642.230345] Lustre: lustre-OST0001: new disk, initializing [ 3642.232938] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3642.236482] Lustre: 227149:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3642.275439] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3644.370646] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3644.943583] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3644.947462] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3644.984514] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3649.940104] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3653.712930] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 3667.424114] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3667.426738] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3667.431429] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3670.498338] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3670.498814] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3670.502357] Lustre: Skipped 2 previous similar messages [ 3670.507119] Lustre: Skipped 3 previous similar messages [ 3672.225490] Lustre: server umount lustre-MDT0000 complete [ 3673.351969] LustreError: 224870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424464 with bad export cookie 1800834574766939885 [ 3673.354040] LustreError: 225611:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 3673.355128] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3673.355228] LustreError: 224870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3673.459408] Lustre: server umount lustre-MDT0001 complete [ 3684.867462] Lustre: server umount lustre-OST0000 complete [ 3696.348078] Lustre: server umount lustre-OST0001 complete [ 3703.379242] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 3706.756137] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3706.896314] LustreError: 230238:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3706.902165] LustreError: 230238:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3706.918760] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3708.225990] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3710.903564] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3712.351334] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3713.344677] Lustre: 231346:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3715.574028] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3715.692777] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3715.695517] Lustre: Skipped 1 previous similar message [ 3716.707328] LustreError: 231702:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3716.711245] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 3717.677498] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3720.719100] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3720.798521] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 3722.850758] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3725.932898] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3727.132621] Lustre: 233187:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3736.547255] Lustre: mylustre-MDT0000-lwp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3736.548202] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3736.551258] Lustre: Skipped 3 previous similar messages [ 3736.553492] Lustre: Skipped 2 previous similar messages [ 3736.556765] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3741.665809] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3741.668057] Lustre: Skipped 4 previous similar messages [ 3742.619394] Lustre: server umount mylustre-MDT0000 complete [ 3743.925254] LustreError: 230213:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424535 with bad export cookie 1800834574766942692 [ 3743.928097] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3743.929558] LustreError: 230213:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3744.044554] Lustre: server umount mylustre-MDT0001 complete [ 3755.012225] Lustre: server umount mylustre-OST0000 complete [ 3766.492502] Lustre: server umount mylustre-OST0001 complete [ 3773.585924] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 3777.364503] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3777.543149] LustreError: 235478:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3777.571054] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3777.572949] Lustre: Skipped 1 previous similar message [ 3778.957479] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3781.897830] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3783.327216] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3784.349226] Lustre: 236591:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3786.685086] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3787.877064] LustreError: 236945:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3787.880766] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 3788.692714] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3791.623731] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3792.747342] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 3793.684551] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3796.859031] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3798.044483] Lustre: 238432:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3807.712112] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3807.715755] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3807.721883] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 3811.154898] Lustre: server umount tfs-MDT0000 complete [ 3812.370997] LustreError: 238435:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424603 with bad export cookie 1800834574766944645 [ 3812.374609] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3812.375017] LustreError: 238435:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3812.493695] Lustre: server umount tfs-MDT0001 complete [ 3823.947096] Lustre: server umount tfs-OST0000 complete [ 3835.482170] Lustre: server umount tfs-OST0001 complete [ 3842.725375] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 3846.679905] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3846.886418] LustreError: 240667:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3846.915969] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3846.918458] Lustre: Skipped 3 previous similar messages [ 3848.359310] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3851.193861] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3852.660666] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3853.656313] Lustre: 241773:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3855.903674] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3857.061968] LustreError: 242127:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3857.065031] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 3857.916035] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3860.894686] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3862.060641] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 3863.088355] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3866.285974] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3867.644883] Lustre: 243614:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3875.065220] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 21:04:26 (1777424666) [ 3887.071881] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3887.074632] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3887.079622] Lustre: Skipped 3 previous similar messages [ 3887.082471] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3887.084978] Lustre: Skipped 4 previous similar messages [ 3901.407118] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3901.474739] Lustre: server umount lustre-MDT0000 complete [ 3902.654980] LustreError: 240642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424694 with bad export cookie 1800834574766946339 [ 3902.656310] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3902.659327] LustreError: 240642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3902.944179] LustreError: 242310:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3902.944600] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3902.948604] LustreError: 242310:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3902.952087] Lustre: Skipped 4 previous similar messages [ 3908.064645] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3908.066746] Lustre: Skipped 14 previous similar messages [ 3908.844120] Lustre: server umount lustre-MDT0001 complete [ 3916.160959] Lustre: server umount lustre-OST0000 complete [ 3923.543605] Lustre: server umount lustre-OST0001 complete [ 3925.604977] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 3928.701433] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 3940.140087] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 3940.140087] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3940.140087] [ 3940.150108] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3940.251969] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3940.266456] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3940.305955] Lustre: lustre-MDT0000: new disk, initializing [ 3940.331042] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3940.334066] Lustre: Skipped 3 previous similar messages [ 3940.339800] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3941.637940] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3945.795589] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 3945.795589] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3945.795589] [ 3945.821541] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3945.861635] Lustre: 246758:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3945.894340] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3945.896735] Lustre: Skipped 1 previous similar message [ 3945.936331] Lustre: lustre-MDT0001: new disk, initializing [ 3945.987544] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3945.991548] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3947.308069] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3951.493204] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3951.599921] Lustre: lustre-OST0000: new disk, initializing [ 3951.601757] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3951.604630] Lustre: 248303:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3952.825508] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3952.829048] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3952.866504] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3953.451705] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3957.458126] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3957.514762] Lustre: lustre-OST0001: new disk, initializing [ 3957.516985] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3957.519365] Lustre: 249158:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3959.039192] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3959.042239] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3959.080054] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3959.318820] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 3963.707121] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 21:05:55 (1777424755) [ 3967.400029] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 21:05:59 (1777424759) [ 3979.748332] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3979.749979] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3979.753294] Lustre: Skipped 1 previous similar message [ 3979.757311] Lustre: Skipped 1 previous similar message [ 3993.055120] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3993.094648] Lustre: server umount lustre-OST0000 complete [ 3995.106964] LustreError: 248288:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3995.114239] LustreError: 248288:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4000.746408] Lustre: server umount lustre-MDT0000 complete [ 4002.055226] LustreError: 247535:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424793 with bad export cookie 1800834574766947893 [ 4002.057906] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4002.059296] LustreError: 247535:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4008.243040] Lustre: server umount lustre-MDT0001 complete [ 4011.744275] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 4021.589628] Lustre: server umount lustre-OST0001 complete [ 4023.541161] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 4029.783316] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4042.077444] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4042.164237] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4042.176892] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4042.214139] Lustre: lustre-MDT0000: new disk, initializing [ 4042.244968] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4043.591263] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4047.893400] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4047.942995] Lustre: 253614:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4048.053617] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4049.376425] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4052.624135] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4053.931766] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4056.377299] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4056.490956] Lustre: 255359:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4058.423922] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4058.426941] Lustre: Skipped 1 previous similar message [ 4058.429134] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4058.459060] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4058.465340] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4061.691748] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4068.835436] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4068.835884] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4068.838489] LustreError: Skipped 1 previous similar message [ 4068.839730] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4068.843740] Lustre: Skipped 5 previous similar messages [ 4068.845428] Lustre: Skipped 12 previous similar messages [ 4070.295782] Lustre: server umount lustre-OST0000 complete [ 4077.791123] Lustre: server umount lustre-MDT0000 complete [ 4079.073852] LustreError: 253625:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4079.080149] LustreError: 253625:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 4079.108313] LustreError: 255358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424870 with bad export cookie 1800834574766949363 [ 4079.111618] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4079.112585] LustreError: 255358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4079.249953] Lustre: server umount lustre-MDT0001 complete [ 4082.921910] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 4083.973490] Key type lgssc unregistered [ 4084.107782] LNet: 256986:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4084.110850] LNetError: 256986:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4084.120483] LNet: Removed LNI 192.168.204.156@tcp [ 4084.445163] Key type .llcrypt unregistered [ 4084.447048] Key type ._llcrypt unregistered [ 4094.304566] Key type ._llcrypt registered [ 4094.305589] Key type .llcrypt registered [ 4094.339682] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4094.646084] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4094.693586] alg: No test for adler32 (adler32-zlib) [ 4095.548586] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 4095.634966] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 4097.215137] Key type lgssc registered [ 4097.574945] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4100.075509] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4100.082028] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4101.245302] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4102.429515] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4105.124897] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4105.236524] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4106.459344] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4108.227192] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4109.420346] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4111.589186] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4111.695653] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4113.473895] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4115.161865] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4115.486345] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 4120.033306] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4120.034247] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4120.037235] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4122.185402] Lustre: server umount lustre-OST0000 complete [ 4123.363385] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4123.364250] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4123.367077] Lustre: Skipped 1 previous similar message [ 4128.736182] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4128.739191] Lustre: Skipped 2 previous similar messages [ 4129.496217] Lustre: server umount lustre-MDT0000 complete [ 4130.699154] LustreError: 259126:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777424922 with bad export cookie 5256136594862557810 [ 4130.701466] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4130.703658] LustreError: 259126:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4130.811548] Lustre: server umount lustre-MDT0001 complete [ 4134.152344] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 4135.103234] Key type lgssc unregistered [ 4135.241351] LNet: 261635:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4135.244200] LNetError: 261635:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4135.252273] LNet: Removed LNI 192.168.204.156@tcp [ 4135.535920] Key type .llcrypt unregistered [ 4135.537403] Key type ._llcrypt unregistered [ 4141.993484] Key type ._llcrypt registered [ 4141.994867] Key type .llcrypt registered [ 4142.031061] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4142.350603] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4142.379468] alg: No test for adler32 (adler32-zlib) [ 4143.233026] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 4143.320916] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 4144.903188] Key type lgssc registered [ 4145.246507] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4148.020876] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4148.026039] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4163.487235] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 4168.607186] LustreError: 262791:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.156@tcp: failed processing log, type 4: rc = -110 [ 4195.231202] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4197.206934] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4199.097936] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4199.843510] Lustre: server umount lustre-OST0000 complete [ 4205.150797] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 4206.098398] Key type lgssc unregistered [ 4206.236481] LNet: 264292:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4206.238821] LNetError: 264292:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4206.244234] LNet: Removed LNI 192.168.204.156@tcp [ 4206.519386] Key type .llcrypt unregistered [ 4206.520384] Key type ._llcrypt unregistered [ 4220.098339] Key type ._llcrypt registered [ 4220.099375] Key type .llcrypt registered [ 4220.138987] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4220.456704] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4220.483825] alg: No test for adler32 (adler32-zlib) [ 4221.343015] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 4221.427529] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 4223.015154] Key type lgssc registered [ 4223.388643] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4227.687754] loop0: detected capacity change from 0 to 204800000 [ 4227.736293] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4227.739403] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4227.846451] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4228.172964] loop0: detected capacity change from 0 to 204800000 [ 4228.230504] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4228.234493] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4228.360728] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4228.713049] loop0: detected capacity change from 0 to 204800000 [ 4228.767575] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4228.771532] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4228.808062] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4229.173136] loop0: detected capacity change from 0 to 204800000 [ 4229.232488] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4229.606398] loop0: detected capacity change from 0 to 204800000 [ 4229.615111] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4230.910733] loop0: detected capacity change from 0 to 204800000 [ 4230.920075] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4232.229561] loop0: detected capacity change from 0 to 204800000 [ 4232.240197] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4233.432581] loop0: detected capacity change from 0 to 204800000 [ 4233.441933] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4234.652163] loop0: detected capacity change from 0 to 204800000 [ 4234.674286] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4234.684676] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4234.722625] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4234.726185] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 4234.729911] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 4234.733747] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4234.737124] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4234.740597] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 4234.746104] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4234.751304] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 4234.754525] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 4234.758081] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 4234.762757] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 4234.767889] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 4234.771281] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 4234.774786] Lustre: 267664:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 4237.319996] Lustre: server umount MGS complete [ 4237.652218] loop0: detected capacity change from 0 to 204800000 [ 4237.680482] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4237.846319] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4237.861978] Lustre: lustre-MDT0000: Aborting client recovery [ 4238.153161] loop1: detected capacity change from 0 to 204800000 [ 4238.187540] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4238.225541] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4238.230118] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 4238.234927] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4238.240823] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 4238.246403] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4238.251900] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4238.255927] Lustre: 268094:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 4238.262822] Lustre: Found index 1 for lustre-MDT0001, updating log [ 4238.650910] loop2: detected capacity change from 0 to 204800000 [ 4238.677352] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4238.727658] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4238.733266] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4238.738680] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4238.744278] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4238.749048] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4238.752153] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4238.756522] Lustre: 268175:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4238.802892] Lustre: Found index 0 for lustre-OST0000, updating log [ 4238.815401] Lustre: 268193:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4238.835623] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4238.838006] Lustre: Skipped 1 previous similar message [ 4238.844278] Lustre: lustre-OST0000: Aborting recovery [ 4239.137625] loop3: detected capacity change from 0 to 204800000 [ 4239.163276] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4239.210099] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4239.213427] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4239.217416] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4239.220672] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4239.224150] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4239.228623] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4239.234068] Lustre: 268258:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4244.456258] LustreError: 268038:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 6, retries 0, failed: rc = -108 [ 4248.546312] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4248.547168] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4248.547724] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 4248.551591] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 4248.558156] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 4248.558759] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 4254.634807] LustreError: 268006:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 203us: rc = -2 [ 4269.024756] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4269.025341] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4269.028280] Lustre: Skipped 3 previous similar messages [ 4269.029941] Lustre: Skipped 2 previous similar messages [ 4269.032882] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4271.895486] Lustre: server umount lustre-MDT0000 complete [ 4272.187616] LustreError: 267989:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425063 with bad export cookie 6519335925451908917 [ 4272.189360] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4272.191622] LustreError: 267989:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4274.143531] LustreError: 268003:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4274.143754] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4274.144026] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4274.144032] Lustre: Skipped 1 previous similar message [ 4274.147858] LustreError: 268003:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4274.151309] Lustre: Skipped 1 previous similar message [ 4277.151486] LustreError: 268003:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4277.151775] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4277.158621] LustreError: 268003:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4277.161149] Lustre: Skipped 2 previous similar messages [ 4278.388929] Lustre: server umount lustre-MDT0001 complete [ 4284.797718] Lustre: server umount lustre-OST0000 complete [ 4291.218296] Lustre: server umount lustre-OST0001 complete [ 4293.541590] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 21:11:25 (1777425085) [ 4301.787789] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 4304.617708] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4316.155123] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4316.231883] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4316.240984] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4316.274653] Lustre: lustre-MDT0000: new disk, initializing [ 4316.295888] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4316.298034] Lustre: Skipped 1 previous similar message [ 4316.303724] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4317.486941] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4321.351031] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4321.392371] Lustre: 272297:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4321.414329] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4321.417139] Lustre: Skipped 1 previous similar message [ 4321.450482] Lustre: lustre-MDT0001: new disk, initializing [ 4321.482173] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4321.494977] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4321.498247] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4322.670155] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4325.589023] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4326.708804] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4328.891450] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4328.985903] Lustre: lustre-OST0000: new disk, initializing [ 4328.987838] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4328.990091] Lustre: 274037:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4328.992421] Lustre: 274037:0:(osd_compat.c:1352:osd_object_spec_find()) Skipped 1 previous similar message [ 4329.019247] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4330.681859] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4331.315531] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4331.319135] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4331.345395] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4333.501793] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4335.761236] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4341.936901] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4346.310333] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4392.929430] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4392.930648] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4392.932009] LustreError: Skipped 1 previous similar message [ 4392.935805] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4392.938898] Lustre: Skipped 1 previous similar message [ 4397.588660] Lustre: server umount lustre-OST0000 complete [ 4403.169231] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4403.170333] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4403.173549] Lustre: Skipped 2 previous similar messages [ 4404.893283] Lustre: server umount lustre-MDT0000 complete [ 4406.143321] LustreError: 273073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425197 with bad export cookie 6519335925451911619 [ 4406.146273] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4406.148106] LustreError: 273073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4406.257763] Lustre: server umount lustre-MDT0001 complete [ 4409.069716] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4410.318684] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4411.867971] Lustre: server umount MGS complete [ 4415.416923] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4415.554908] LustreError: 277814:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4415.561097] LustreError: 277826:0:(qmt_pool.c:1614:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4415.581468] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4416.847841] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4419.548134] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4420.899581] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4422.752706] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4423.941926] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4426.086177] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4427.963710] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4429.606378] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4466.144764] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4466.146193] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4466.147436] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4466.147439] Lustre: Skipped 1 previous similar message [ 4466.147489] LustreError: Skipped 1 previous similar message [ 4466.150921] Lustre: Skipped 1 previous similar message [ 4468.619847] Lustre: server umount lustre-OST0000 complete [ 4470.751723] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4484.063195] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4484.129195] Lustre: server umount lustre-MDT0000 complete [ 4485.269048] LustreError: 280224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425276 with bad export cookie 6519335925451913446 [ 4485.272528] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4485.272713] LustreError: 280224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4485.388806] Lustre: server umount lustre-MDT0001 complete [ 4488.743829] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 4489.776115] Key type lgssc unregistered [ 4489.898318] LNet: 281425:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4489.901144] LNetError: 281425:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4489.910272] LNet: Removed LNI 192.168.204.156@tcp [ 4490.211931] Key type .llcrypt unregistered [ 4490.213155] Key type ._llcrypt unregistered [ 4501.537246] Key type ._llcrypt registered [ 4501.538375] Key type .llcrypt registered [ 4501.580409] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 4507.534088] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4507.884109] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4507.934252] alg: No test for adler32 (adler32-zlib) [ 4508.808426] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 4508.903199] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 4510.487192] Key type lgssc registered [ 4510.837708] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4521.687763] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4521.693687] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4522.773232] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4522.783010] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4522.815391] Lustre: lustre-MDT0000: new disk, initializing [ 4522.838135] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4522.844144] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4524.063138] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4528.022180] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4528.061145] Lustre: 285323:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4528.084381] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4528.086580] Lustre: Skipped 1 previous similar message [ 4528.119036] Lustre: lustre-MDT0001: new disk, initializing [ 4528.150456] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4528.163206] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4528.166341] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4529.357476] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4532.257295] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4533.420662] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4535.637663] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4535.757204] Lustre: lustre-OST0000: new disk, initializing [ 4535.759212] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4535.762762] Lustre: 287062:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4535.789565] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4536.566990] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4536.570549] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4536.599281] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4537.582359] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4540.553901] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4543.904731] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4552.721890] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4562.253300] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4566.752205] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 4613.602583] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4613.602674] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4613.605929] LustreError: Skipped 1 previous similar message [ 4613.611534] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4613.615280] Lustre: Skipped 1 previous similar message [ 4617.678269] Lustre: server umount lustre-OST0000 complete [ 4620.255814] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4620.258205] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4620.261960] Lustre: Skipped 1 previous similar message [ 4620.263686] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4623.840069] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4623.840382] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4624.980654] Lustre: server umount lustre-MDT0000 complete [ 4626.100082] LustreError: 285315:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425417 with bad export cookie 11169408810364407297 [ 4626.103329] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4626.104042] LustreError: 285315:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4626.208505] Lustre: server umount lustre-MDT0001 complete [ 4628.814570] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4629.940771] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4631.401941] Lustre: server umount MGS complete [ 4634.898675] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4635.034233] LustreError: 291140:0:(qmt_pool.c:1614:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4635.055902] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4636.205799] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4638.837584] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4640.139661] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4641.739372] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4642.803026] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4644.820935] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4644.915346] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4644.917218] Lustre: Skipped 1 previous similar message [ 4646.605578] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4648.220694] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4666.335729] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4666.337912] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4666.341391] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4666.343185] Lustre: Skipped 1 previous similar message [ 4669.408614] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4671.757712] Lustre: server umount lustre-OST0000 complete [ 4674.528635] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4674.529220] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4674.532972] Lustre: Skipped 2 previous similar messages [ 4674.535485] Lustre: Skipped 3 previous similar messages [ 4684.768503] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4684.770245] Lustre: Skipped 3 previous similar messages [ 4687.327100] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4687.389506] Lustre: server umount lustre-MDT0000 complete [ 4688.571361] LustreError: 291108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425480 with bad export cookie 11169408810364409138 [ 4688.574262] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4688.576212] LustreError: 291108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4688.680672] Lustre: server umount lustre-MDT0001 complete [ 4691.964540] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 4693.033618] Key type lgssc unregistered [ 4693.158497] LNet: 294714:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4693.162117] LNetError: 294714:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4693.169338] LNet: Removed LNI 192.168.204.156@tcp [ 4693.460501] Key type .llcrypt unregistered [ 4693.462046] Key type ._llcrypt unregistered [ 4699.960306] Key type ._llcrypt registered [ 4699.961465] Key type .llcrypt registered [ 4700.000044] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 4705.852137] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4706.142805] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4706.155835] alg: No test for adler32 (adler32-zlib) [ 4707.005180] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 4707.090528] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 4708.671141] Key type lgssc registered [ 4709.057529] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4716.505923] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4721.158308] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4721.163357] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4722.251527] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4722.261954] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4722.299320] Lustre: lustre-MDT0000: new disk, initializing [ 4722.322562] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4722.328573] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4723.539372] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4727.521430] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4727.631180] Lustre: lustre-OST0000: new disk, initializing [ 4727.633776] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4727.635379] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 4727.636122] Lustre: Skipped 1 previous similar message [ 4727.640721] Lustre: 298672:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4727.659770] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4729.395049] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4732.912276] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4732.916292] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4732.923954] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4904.291747] Lustre: server umount lustre-MDT0000 complete [ 4905.555498] LustreError: 297873:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425697 with bad export cookie 8684599781236675261 [ 4905.560373] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4916.252569] Lustre: server umount lustre-OST0000 complete [ 4924.670000] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 4928.046433] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 4940.441479] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4940.542690] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4940.556867] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4940.600844] Lustre: lustre-MDT0000: new disk, initializing [ 4940.626842] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4940.635328] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4941.999961] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4946.167299] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4946.207927] Lustre: 302847:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4946.232743] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4946.234839] Lustre: Skipped 1 previous similar message [ 4946.272462] Lustre: lustre-MDT0001: new disk, initializing [ 4946.306938] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4946.322796] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4946.327741] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4947.652280] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4950.777385] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4952.054835] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4954.379774] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4954.486037] Lustre: lustre-OST0000: new disk, initializing [ 4954.489322] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4954.494303] Lustre: 304587:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4954.527379] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4956.394708] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4956.536058] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4956.541104] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4956.576710] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4959.379677] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4960.639471] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4960.710596] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4961.960132] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4962.028072] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4966.881982] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4966.882495] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4966.884465] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4966.888301] Lustre: Skipped 1 previous similar message [ 4968.716763] Lustre: server umount lustre-OST0000 complete [ 4972.000705] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4972.001024] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4972.001439] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4972.001444] Lustre: Skipped 1 previous similar message [ 4972.003138] LustreError: Skipped 1 previous similar message [ 4972.010410] Lustre: Skipped 1 previous similar message [ 4977.119950] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4977.122183] Lustre: Skipped 2 previous similar messages [ 4982.240041] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4982.242307] Lustre: Skipped 1 previous similar message [ 4984.287089] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4984.343977] Lustre: server umount lustre-MDT0000 complete [ 4985.479072] LustreError: 302840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425776 with bad export cookie 8684599781239616052 [ 4985.481766] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4985.483181] LustreError: 302840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4985.598311] Lustre: server umount lustre-MDT0001 complete [ 4986.650558] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 4987.133879] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 21:22:58 (1777425778) [ 4989.216685] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4989.377516] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4990.587997] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4993.198333] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4994.416052] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 4996.031363] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4997.117192] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4999.193509] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5000.993581] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5002.645725] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5004.832894] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5004.893016] Lustre: lustre-OST0001: new disk, initializing [ 5004.895448] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5004.898765] Lustre: 309250:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5006.696102] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5010.136713] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5010.204599] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5010.435954] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5010.438968] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5010.454143] LustreError: 310053:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5011.288239] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9e52bb1ce800.ost_server_uuid 50 [ 5011.490138] LustreError: 310053:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5011.493742] LustreError: 310053:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 5011.770031] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9e52bb1ce800.ost_server_uuid in FULL state after 0 sec [ 5012.514568] LustreError: 310053:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5012.517705] LustreError: 310053:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 5012.921512] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9e52bb1ce800.ost_server_uuid 50 [ 5013.452932] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9e52bb1ce800.ost_server_uuid in FULL state after 0 sec [ 5014.568510] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5025.763434] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5025.764383] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5025.767030] Lustre: Skipped 1 previous similar message [ 5031.100754] Lustre: server umount lustre-OST0001 complete [ 5034.464466] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5034.466524] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5036.002829] LustreError: 308979:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5036.006839] LustreError: 308979:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5038.606309] Lustre: server umount lustre-OST0000 complete [ 5041.120705] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5041.123800] Lustre: Skipped 2 previous similar messages [ 5045.906861] Lustre: server umount lustre-MDT0000 complete [ 5046.239847] LustreError: 307462:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5046.244605] LustreError: 307462:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5047.069101] LustreError: 306732:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425838 with bad export cookie 8684599781239616920 [ 5047.072400] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5047.072876] LustreError: 306732:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5047.182954] Lustre: server umount lustre-MDT0001 complete [ 5050.730266] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 5051.650882] Key type lgssc unregistered [ 5051.773236] LNet: 311688:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5051.775512] LNetError: 311688:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5051.785283] LNet: Removed LNI 192.168.204.156@tcp [ 5052.067221] Key type .llcrypt unregistered [ 5052.068513] Key type ._llcrypt unregistered [ 5060.551990] Key type ._llcrypt registered [ 5060.552809] Key type .llcrypt registered [ 5060.582185] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 5060.905342] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5060.927834] alg: No test for adler32 (adler32-zlib) [ 5061.766994] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 5061.840882] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 5063.415151] Key type lgssc registered [ 5063.743767] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5066.099990] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5066.104758] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5067.251914] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5068.433994] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5070.063327] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5072.171310] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5072.301268] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5073.539572] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5076.421953] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5076.525919] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5077.541342] LustreError: 314808:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5077.545488] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 5077.547496] LustreError: 314808:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5078.191260] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5079.804540] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5081.634829] LustreError: 314809:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5081.639952] LustreError: 314809:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5081.838373] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5081.905527] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5083.127596] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 5083.639749] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5085.273965] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5087.664530] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 5087.734521] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5164.003437] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5164.008988] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5164.012064] Lustre: Skipped 1 previous similar message [ 5169.122290] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5169.124600] Lustre: Skipped 1 previous similar message [ 5174.242725] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5174.245201] Lustre: Skipped 1 previous similar message [ 5177.311125] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5177.343510] Lustre: server umount lustre-OST0001 complete [ 5179.360552] LustreError: 314617:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5179.363326] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5179.364471] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5179.365912] LustreError: 314617:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5179.370156] Lustre: Skipped 2 previous similar messages [ 5184.480219] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5184.480707] LustreError: 314809:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5184.483410] Lustre: Skipped 2 previous similar messages [ 5184.489263] LustreError: 314809:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5189.601829] LustreError: 314617:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5189.608951] LustreError: 314617:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5193.183134] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5193.237719] Lustre: server umount lustre-OST0000 complete [ 5194.720196] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5194.721120] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5194.724988] Lustre: Skipped 1 previous similar message [ 5194.726605] Lustre: Skipped 2 previous similar messages [ 5200.536112] Lustre: server umount lustre-MDT0000 complete [ 5201.766318] LustreError: 313885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777425993 with bad export cookie 6387488103228914710 [ 5201.771150] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5201.886743] Lustre: server umount lustre-MDT0001 complete [ 5205.274984] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 5206.278515] Key type lgssc unregistered [ 5206.401496] LNet: 317620:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5206.404120] LNetError: 317620:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5206.414333] LNet: Removed LNI 192.168.204.156@tcp [ 5206.697469] Key type .llcrypt unregistered [ 5206.698447] Key type ._llcrypt unregistered [ 5223.182062] Key type ._llcrypt registered [ 5223.183795] Key type .llcrypt registered [ 5223.217609] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 5223.489437] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5223.498314] alg: No test for adler32 (adler32-zlib) [ 5224.340012] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 5224.413023] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 5225.991156] Key type lgssc registered [ 5226.335244] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5229.290143] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5229.297089] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5230.443492] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5231.579076] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5234.171155] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5234.286612] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5235.451327] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5236.359903] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5238.438046] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5238.548856] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5239.586312] LustreError: 321326:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5239.590714] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 5239.591967] LustreError: 321326:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5240.253585] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5242.947486] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5243.040500] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5244.074338] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 5244.744641] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5248.634871] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5255.146621] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5264.867357] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5264.869233] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5264.870286] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5264.871583] Lustre: Skipped 3 previous similar messages [ 5269.917878] Lustre: server umount lustre-MDT0000 complete [ 5269.987957] LustreError: 320584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5269.993994] LustreError: 320584:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5271.152306] LustreError: 319852:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777426062 with bad export cookie 3026476011942601370 [ 5271.155756] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5271.156590] LustreError: 319852:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5271.272692] Lustre: server umount lustre-MDT0001 complete [ 5283.331423] Lustre: server umount lustre-OST0000 complete [ 5294.943674] Lustre: server umount lustre-OST0001 complete [ 5300.173642] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 5303.528643] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5303.658882] LustreError: 325052:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5303.680179] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5304.909934] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5307.622960] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5309.047753] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5310.049505] Lustre: 326160:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5312.260137] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5312.374970] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5312.377252] Lustre: Skipped 1 previous similar message [ 5314.118290] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5314.403837] LustreError: 326514:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5314.407481] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 5316.786246] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5317.931430] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 5318.592430] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5321.607344] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5322.726922] Lustre: 328001:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5333.475227] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5333.476639] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5333.476827] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5333.480397] Lustre: Skipped 2 previous similar messages [ 5333.486294] Lustre: Skipped 6 previous similar messages [ 5334.744632] Lustre: server umount lustre-MDT0000 complete [ 5335.973307] LustreError: 325032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777426127 with bad export cookie 3026476011942603057 [ 5335.976936] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5335.977028] LustreError: 325032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5336.101142] Lustre: server umount lustre-MDT0001 complete [ 5346.816942] Lustre: server umount lustre-OST0000 complete [ 5358.173477] Lustre: server umount lustre-OST0001 complete [ 5359.227517] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 5359.681930] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 5360.174448] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 21:29:11 (1777426151) [ 5366.988194] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 5369.671892] loop0: detected capacity change from 0 to 1099511627776 [ 5369.799059] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 5369.801493] *** VALIDATE xfs *** [ 5369.804919] XFS (loop0): Mounting V5 Filesystem [ 5369.812302] XFS (loop0): Ending clean mount [ 5370.178986] loop1: detected capacity change from 0 to 18691697672192 [ 5389.754227] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 5392.747093] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 5404.088724] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5404.174951] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5404.186675] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5404.226688] Lustre: lustre-MDT0000: new disk, initializing [ 5404.250743] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5404.253405] Lustre: Skipped 1 previous similar message [ 5404.258977] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5405.578385] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5409.889626] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5409.935215] Lustre: 333063:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5409.959039] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5409.961496] Lustre: Skipped 1 previous similar message [ 5409.995392] Lustre: lustre-MDT0001: new disk, initializing [ 5410.039278] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5410.043472] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5411.308801] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5414.347364] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5415.505355] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5417.669549] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5417.773394] Lustre: lustre-OST0000: new disk, initializing [ 5417.775463] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5417.778677] Lustre: 334802:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5419.259369] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5419.263040] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5419.294244] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5419.665123] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5422.728325] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5424.007703] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5424.086808] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5425.312044] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 5425.378497] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5429.729681] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5429.729759] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5429.730887] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5429.731983] LustreError: Skipped 1 previous similar message [ 5429.734861] Lustre: Skipped 2 previous similar messages [ 5432.079686] Lustre: server umount lustre-OST0000 complete [ 5434.848519] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5434.849062] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5434.851570] Lustre: Skipped 1 previous similar message [ 5434.854209] Lustre: Skipped 2 previous similar messages [ 5439.384498] Lustre: server umount lustre-MDT0000 complete [ 5439.967996] LustreError: 333072:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5439.973975] LustreError: 333072:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5440.533209] LustreError: 333055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777426232 with bad export cookie 3026476011942604611 [ 5440.536584] LustreError: 333055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5440.537155] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5440.662123] Lustre: server umount lustre-MDT0001 complete [ 5443.248173] XFS (loop0): Unmounting Filesystem [ 5444.744965] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 21:30:36 (1777426236) [ 5446.890281] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5447.041976] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5447.043952] Lustre: Skipped 2 previous similar messages [ 5448.296953] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5451.032941] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5452.428663] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5454.138251] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5455.320123] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5457.567299] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5459.525957] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5461.148846] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5481.439746] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5481.441918] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5481.445531] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5485.907884] Lustre: server umount lustre-OST0000 complete [ 5487.071789] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5487.073679] LustreError: Skipped 1 previous similar message [ 5492.704079] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5492.706409] Lustre: Skipped 5 previous similar messages [ 5501.407135] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5501.482283] Lustre: server umount lustre-MDT0000 complete [ 5502.663973] LustreError: 337926:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777426294 with bad export cookie 3026476011942605493 [ 5502.666652] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5502.667973] LustreError: 337926:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5502.773501] Lustre: server umount lustre-MDT0001 complete [ 5506.061239] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 5507.004232] Key type lgssc unregistered [ 5507.128307] LNet: 340507:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5507.131074] LNetError: 340507:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5507.142269] LNet: Removed LNI 192.168.204.156@tcp [ 5507.415127] Key type .llcrypt unregistered [ 5507.416570] Key type ._llcrypt unregistered [ 5517.237631] Key type ._llcrypt registered [ 5517.238606] Key type .llcrypt registered [ 5517.274068] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 5517.696492] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5517.706126] alg: No test for adler32 (adler32-zlib) [ 5518.547565] Lustre: Lustre: Build Version: 2.17.50_193_g6a09ae0 [ 5518.621604] LNet: Added LNI 192.168.204.156@tcp [8/256/0/180] [ 5520.199183] Key type lgssc registered [ 5520.571804] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5523.007517] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5523.013515] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5524.163106] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5525.321643] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5527.951176] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5528.073299] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5529.249502] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5530.870262] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5531.952788] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5534.061537] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5534.170513] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5535.957795] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5537.569894] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5548.513396] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5548.513974] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5548.520777] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5548.522607] Lustre: Skipped 1 previous similar message [ 5552.272704] Lustre: server umount lustre-MDT0001 complete [ 5553.632197] LustreError: 342037:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5553.637906] LustreError: 342037:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5555.517646] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5555.552477] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5555.554453] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5555.565734] Lustre: 342027:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5555.664598] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5556.859272] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5560.807324] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5562.852310] LustreError: 345443:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5562.855012] LustreError: 345443:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5562.857799] LustreError: 342029:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5562.874034] LustreError: 345446:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.204.156@tcp: cfg command failed: rc = -17 [ 5562.876656] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 5562.876656] [ 5861.319954] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.56@tcp (stopping) [ 5861.323591] Lustre: Skipped 1 previous similar message [ 5862.881373] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5862.881797] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5862.890254] Lustre: Skipped 1 previous similar message [ 5862.893327] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5862.896259] Lustre: Skipped 1 previous similar message [ 5865.750790] Lustre: server umount lustre-MDT0001 complete [ 5866.429395] LustreError: 342032:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5866.437757] LustreError: 342032:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5868.000271] LustreError: 353583:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5868.007564] LustreError: 353583:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5869.251723] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5869.289042] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5869.291761] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5869.307480] Lustre: 342027:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5869.410280] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5870.618564] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 5874.661609] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5877.221139] LustreError: 358252:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5877.223324] LustreError: 358252:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5877.226171] LustreError: 342029:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5877.229013] LustreError: 342029:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5877.245860] LustreError: 358255:0:(obd_config.c:797:class_setup()) Device 8 already setup (type osp) [ 5877.247732] LustreError: 358255:0:(obd_config.c:902:class_detach()) OBD device 8 still set up [ 5877.249513] LustreError: 358255:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.204.156@tcp: cfg command failed: rc = -17 [ 5877.252319] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.204.156@tcp [ 5877.252319] [ 6173.637370] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.56@tcp (stopping) [ 6176.738025] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 6176.738101] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6176.745784] Lustre: Skipped 1 previous similar message [ 6178.749464] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.56@tcp (stopping) [ 6178.753022] Lustre: Skipped 2 previous similar messages [ 6179.476487] Lustre: server umount lustre-MDT0001 complete [ 6181.858633] LustreError: 349765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6181.865914] LustreError: 349765:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6183.053316] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6183.090950] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 6183.093211] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6183.108811] Lustre: 342027:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6183.228556] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 6184.558986] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 6188.519538] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 6191.078338] LustreError: 370979:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 6191.082072] LustreError: 370979:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 6191.086160] LustreError: 342029:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 6191.088921] LustreError: 342029:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 6191.109240] LustreError: 370992:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 6191.115205] LustreError: 370992:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.204.156@tcp: cfg command failed: rc = -114 [ 6191.118576] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 6191.118576] [ 6500.834136] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6500.834802] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6500.835084] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6500.839913] Lustre: Skipped 2 previous similar messages [ 6505.116032] Lustre: server umount lustre-MDT0000 complete [ 6505.954346] LustreError: 344182:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6505.959677] LustreError: 344182:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6506.398196] LustreError: 342016:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777427297 with bad export cookie 2705941880421795303 [ 6506.401446] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6506.402060] LustreError: 342016:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6511.073265] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6511.078592] Lustre: Skipped 1 previous similar message [ 6512.552773] Lustre: server umount lustre-MDT0001 complete [ 6513.899474] Lustre: server umount lustre-OST0000 complete [ 6516.976949] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 6520.037847] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 6531.788033] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 21:48:43 (1777427323) [ 6533.926891] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6534.015484] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6534.025589] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6534.060492] Lustre: lustre-MDT0000: new disk, initializing [ 6534.086859] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6534.095318] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6535.431246] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 6539.500311] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6539.546249] Lustre: 385686:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6539.573410] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6539.576316] Lustre: Skipped 1 previous similar message [ 6539.620369] Lustre: lustre-MDT0001: new disk, initializing [ 6539.654601] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6539.668332] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6539.671987] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6541.000508] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 6544.134477] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6545.356718] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6547.652790] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6547.777313] Lustre: lustre-OST0000: new disk, initializing [ 6547.779741] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6547.784064] Lustre: 387429:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6547.816417] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6549.052935] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6549.058097] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6549.090253] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6549.652420] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug -1 all [ 6552.660431] Lustre: DEBUG MARKER: oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6559.201929] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6559.204227] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6559.206392] Lustre: Skipped 2 previous similar messages [ 6559.208642] Lustre: Skipped 4 previous similar messages [ 6561.370247] Lustre: server umount lustre-MDT0000 complete [ 6562.567210] LustreError: 385677:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1777427354 with bad export cookie 2705941880421797242 [ 6562.571086] LustreError: MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6562.571795] LustreError: 386476:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 6562.571930] LustreError: 386476:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@000000007970e71d x1863766570794496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 6562.572576] LustreError: 385677:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6562.685569] Lustre: server umount lustre-MDT0001 complete [ 6574.171792] Lustre: server umount lustre-OST0000 complete [ 6583.106342] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing set_hostid [ 6585.995214] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local [ 6596.299642] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 6473 sec ========== 21:49:47 (1777427387) [ 6596.905635] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 21:49:48 (1777427388) === [ 6598.158995] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 21:49:49 (1777427389) === [ 6611.134509] Lustre: DEBUG MARKER: oleg456-server.virtnet: executing unload_modules_local [ 6612.184672] Key type lgssc unregistered [ 6612.313322] LNet: 393617:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6612.315951] LNetError: 393617:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6612.325421] LNet: Removed LNI 192.168.204.156@tcp [ 6612.622090] Key type .llcrypt unregistered [ 6612.623275] Key type ._llcrypt unregistered