[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 501331833 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002000] x2apic enabled [ 0.002000] Switched APIC routing to physical x2apic. [ 0.002010] kvm-guest: setup PV IPIs [ 0.004826] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.005000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.005011] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.006005] pid_max: default: 32768 minimum: 301 [ 0.007098] LSM: Security Framework initializing [ 0.008032] Yama: becoming mindful. [ 0.009023] SELinux: Initializing. [ 0.009828] *** VALIDATE selinux *** [ 0.017706] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.022204] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.023107] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.024077] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.025072] *** VALIDATE tmpfs *** [ 0.027169] *** VALIDATE proc *** [ 0.028175] *** VALIDATE cgroup *** [ 0.029005] *** VALIDATE cgroup2 *** [ 0.030226] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.031120] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.032003] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.033018] Spectre V2 : User space: Vulnerable [ 0.034005] Speculative Store Bypass: Vulnerable [ 0.037265] debug: unmapping init [mem 0xffffffffb8e59000-0xffffffffb8e60fff] [ 0.039339] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.040509] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.041010] ... version: 2 [ 0.042006] ... bit width: 48 [ 0.043006] ... generic registers: 4 [ 0.044006] ... value mask: 0000ffffffffffff [ 0.045007] ... max period: 00007fffffffffff [ 0.046007] ... fixed-purpose events: 3 [ 0.047007] ... event mask: 000000070000000f [ 0.049168] rcu: Hierarchical SRCU implementation. [ 0.051499] smp: Bringing up secondary CPUs ... [ 0.052455] x86: Booting SMP configuration: [ 0.053012] .... node #0, CPUs: #1 #2 #3 [ 0.058628] smp: Brought up 1 node, 4 CPUs [ 0.060012] smpboot: Max logical packages: 1 [ 0.061008] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.136663] node 0 deferred pages initialised in 75ms [ 0.140378] devtmpfs: initialized [ 0.141235] x86/mm: Memory block size: 128MB [ 0.143885] gcov: version magic: 0x41383552 [ 0.144722] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.148069] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.151223] pinctrl core: initialized pinctrl subsystem [ 0.153105] [ 0.154005] ************************************************************* [ 0.158008] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.161013] ** ** [ 0.164006] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.167025] ** ** [ 0.171048] ** This means that this kernel is built to expose internal ** [ 0.174008] ** IOMMU data structures, which may compromise security on ** [ 0.178008] ** your system. ** [ 0.183011] ** ** [ 0.186008] ** If you see this message and you are not debugging the ** [ 0.189007] ** kernel, report this immediately to your vendor! ** [ 0.191011] ** ** [ 0.194008] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.198013] ************************************************************* [ 0.202142] NET: Registered protocol family 16 [ 0.207764] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.210043] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.212047] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.216107] cpuidle: using governor menu [ 0.217885] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.221566] PCI: Using configuration type 1 for base access [ 0.224159] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.235145] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.241017] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.248028] cryptd: max_cpu_qlen set to 1000 [ 0.251227] ACPI: Added _OSI(Module Device) [ 0.252009] ACPI: Added _OSI(Processor Device) [ 0.254008] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.256008] ACPI: Added _OSI(Processor Aggregator Device) [ 0.262271] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.270441] ACPI: Interpreter enabled [ 0.273042] ACPI: PM: (supports S0 S3 S4 S5) [ 0.277009] ACPI: Using IOAPIC for interrupt routing [ 0.280072] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.286343] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.300577] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.302018] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.305010] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.309159] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.316385] acpiphp: Slot [2] registered [ 0.317089] acpiphp: Slot [5] registered [ 0.319199] acpiphp: Slot [6] registered [ 0.321080] acpiphp: Slot [7] registered [ 0.323115] acpiphp: Slot [8] registered [ 0.324236] acpiphp: Slot [9] registered [ 0.327077] acpiphp: Slot [10] registered [ 0.328079] acpiphp: Slot [3] registered [ 0.330074] acpiphp: Slot [4] registered [ 0.331066] acpiphp: Slot [11] registered [ 0.333055] acpiphp: Slot [12] registered [ 0.335130] acpiphp: Slot [13] registered [ 0.338096] acpiphp: Slot [14] registered [ 0.341086] acpiphp: Slot [15] registered [ 0.343073] acpiphp: Slot [16] registered [ 0.345144] acpiphp: Slot [17] registered [ 0.347107] acpiphp: Slot [18] registered [ 0.350071] acpiphp: Slot [19] registered [ 0.352135] acpiphp: Slot [20] registered [ 0.354070] acpiphp: Slot [21] registered [ 0.356083] acpiphp: Slot [22] registered [ 0.358161] acpiphp: Slot [23] registered [ 0.360217] acpiphp: Slot [24] registered [ 0.363082] acpiphp: Slot [25] registered [ 0.366102] acpiphp: Slot [26] registered [ 0.368092] acpiphp: Slot [27] registered [ 0.371078] acpiphp: Slot [28] registered [ 0.374078] acpiphp: Slot [29] registered [ 0.377088] acpiphp: Slot [30] registered [ 0.380075] acpiphp: Slot [31] registered [ 0.382050] PCI host bridge to bus 0000:00 [ 0.384024] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.388011] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.391011] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.394012] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.397011] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.399041] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.402172] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.405115] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.408339] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.419010] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.423045] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.426010] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.428008] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.430008] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.433535] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.436769] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.441044] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.446831] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.453022] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.468011] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.473008] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.479356] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.488008] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.493007] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.508011] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.531508] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.549013] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.571012] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.641013] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.653706] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.662012] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.670026] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.685013] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.696782] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.704017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.711010] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.728012] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.740913] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.748008] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.755009] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.768012] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.777998] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.785015] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.792034] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.818012] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.841438] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.844442] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.847394] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.851352] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.853212] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.858070] iommu: Default domain type: Passthrough [ 0.859000] SCSI subsystem initialized [ 0.859075] ACPI: bus type USB registered [ 0.860068] usbcore: registered new interface driver usbfs [ 0.862044] usbcore: registered new interface driver hub [ 0.864052] usbcore: registered new device driver usb [ 0.865124] pps_core: LinuxPPS API ver. 1 registered [ 0.867007] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.869084] PTP clock support registered [ 0.871323] EDAC MC: Ver: 3.0.0 [ 0.873059] PCI: Using ACPI for IRQ routing [ 0.873850] NetLabel: Initializing [ 0.875007] NetLabel: domain hash size = 128 [ 0.876005] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.878137] NetLabel: unlabeled traffic allowed by default [ 0.880299] vgaarb: loaded [ 0.881543] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.884008] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.889253] clocksource: Switched to clocksource kvm-clock [ 1.007910] VFS: Disk quotas dquot_6.6.0 [ 1.009472] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.011753] *** VALIDATE ramfs *** [ 1.013373] *** VALIDATE hugetlbfs *** [ 1.014690] pnp: PnP ACPI init [ 1.016504] pnp: PnP ACPI: found 6 devices [ 1.030130] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.032257] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.033713] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.035006] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.036443] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.037976] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.039922] NET: Registered protocol family 2 [ 1.041720] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.045501] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.047900] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.052064] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.054436] TCP: Hash tables configured (established 65536 bind 65536) [ 1.056354] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.058401] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.060268] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.062259] NET: Registered protocol family 1 [ 1.063953] RPC: Registered named UNIX socket transport module. [ 1.065384] RPC: Registered udp transport module. [ 1.066710] RPC: Registered tcp transport module. [ 1.067904] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.069504] NET: Registered protocol family 44 [ 1.070681] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.072183] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.073657] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.075284] PCI: CLS 0 bytes, default 64 [ 1.077207] Unpacking initramfs... [ 2.582983] debug: unmapping init [mem 0xffff9f23fcc54000-0xffff9f23fffbffff] [ 2.586792] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.589077] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.591828] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.139103] Initialise system trusted keyrings [ 3.140983] Key type blacklist registered [ 3.145357] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.154621] zbud: loaded [ 3.157435] *** VALIDATE nfs *** [ 3.158758] *** VALIDATE nfs4 *** [ 3.160243] pstore: using deflate compression [ 3.163588] Platform Keyring initialized [ 3.256872] NET: Registered protocol family 38 [ 3.259131] Key type asymmetric registered [ 3.260139] Asymmetric key parser 'x509' registered [ 3.261705] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.267172] io scheduler mq-deadline registered [ 3.268694] io scheduler kyber registered [ 3.271480] io scheduler bfq registered [ 3.272842] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.275536] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.277994] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.281410] ACPI: Power Button [PWRF] [ 3.287707] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.295893] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.309945] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.318301] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.337640] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.367142] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.397791] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.406603] Non-volatile memory driver v1.3 [ 3.408325] Linux agpgart interface v0.103 [ 3.441476] virtio_blk virtio1: [vda] 135560 512-byte logical blocks (69.4 MB/66.2 MiB) [ 3.444734] vda: detected capacity change from 0 to 69406720 [ 3.465661] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.468575] vdb: detected capacity change from 0 to 1073741824 [ 3.485694] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.488619] vdc: detected capacity change from 0 to 2621440000 [ 3.510353] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.513743] vdd: detected capacity change from 0 to 2621440000 [ 3.532147] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.535223] vde: detected capacity change from 0 to 4294967296 [ 3.557124] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.560126] vdf: detected capacity change from 0 to 4294967296 [ 3.580459] libphy: Fixed MDIO Bus: probed [ 3.589260] usbcore: registered new interface driver usbserial_generic [ 3.592715] usbserial: USB Serial support registered for generic [ 3.595977] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.601821] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.604364] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.607627] mousedev: PS/2 mouse device common for all mice [ 3.611633] rtc_cmos 00:05: RTC can wake from S4 [ 3.614602] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.616947] rtc_cmos 00:05: registered as rtc0 [ 3.626094] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.627530] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.627579] intel_pstate: CPU model not supported [ 3.632258] hid: raw HID events driver (C) Jiri Kosina [ 3.641901] usbcore: registered new interface driver usbhid [ 3.644393] usbhid: USB HID core driver [ 3.646470] drop_monitor: Initializing network drop monitor service [ 3.649943] Initializing XFRM netlink socket [ 3.652366] NET: Registered protocol family 10 [ 3.653170] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.663267] Segment Routing with IPv6 [ 3.664950] NET: Registered protocol family 17 [ 3.666929] mpls_gso: MPLS GSO support [ 3.673412] RAS: Correctable Errors collector initialized. [ 3.675404] AVX version of gcm_enc/dec engaged. [ 3.676856] AES CTR mode by8 optimization enabled [ 3.756466] sched_clock: Marking stable (3756441316, 0)->(4619323491, -862882175) [ 3.760224] registered taskstats version 1 [ 3.761810] Loading compiled-in X.509 certificates [ 3.763679] zswap: loaded using pool lzo/zbud [ 3.790060] Key type big_key registered [ 3.804551] Key type encrypted registered [ 3.806639] ima: No TPM chip found, activating TPM-bypass! [ 3.808850] ima: Allocated hash algorithm: sha1 [ 3.810692] ima: No architecture policies found [ 3.812719] evm: Initialising EVM extended attributes: [ 3.814595] evm: security.selinux [ 3.815774] evm: security.ima [ 3.816912] evm: security.capability [ 3.818233] evm: HMAC attrs: 0x1 [ 3.820796] rtc_cmos 00:05: setting system clock to 2026-03-19 17:27:18 UTC (1773941238) [ 3.827333] debug: unmapping init [mem 0xffffffffb9e03000-0xffffffffb9ffffff] [ 3.837374] debug: unmapping init [mem 0xffffffffb8b82000-0xffffffffb8e58fff] [ 3.850056] Write protecting the kernel read-only data: 28672k [ 3.853699] debug: unmapping init [mem 0xffffffffb7203000-0xffffffffb73fffff] [ 3.856431] debug: unmapping init [mem 0xffffffffb7b14000-0xffffffffb7bfffff] [ 3.920337] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.930439] systemd[1]: Detected virtualization kvm. [ 3.933745] systemd[1]: Detected architecture x86-64. [ 3.936331] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.970226] systemd[1]: No hostname configured. [ 3.972440] systemd[1]: Set hostname to . [ 3.975594] random: systemd: uninitialized urandom read (16 bytes read) [ 3.978843] systemd[1]: Initializing machine ID from random generator. [ 4.145875] random: systemd: uninitialized urandom read (16 bytes read) [ 4.148398] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.154190] random: systemd: uninitialized urandom read (16 bytes read) [ 4.162107] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.165121] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Reached target Sockets. [ OK ] Reached target Local File Systems. Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. Starting Apply Kernel Variables... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.951194] device-mapper: uevent: version 1.0.3 [ 4.952814] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 5.839608] random: fast init done [ 5.849934] virtio_net virtio0 ens2: renamed from eth0 [ 5.897678] scsi host0: ata_piix [ 5.934986] scsi host1: ata_piix [ 5.936253] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.938059] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 10.331114] random: crng init done [ 10.332134] random: 7 urandom warning(s) missed due to ratelimiting [ 10.646793] dracut-initqueue[574]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 12.186374] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 13.860064] printk: systemd: 24 output lines suppressed due to ratelimiting [ 14.277836] SELinux: Disabled at runtime. [ 14.413854] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 14.432315] systemd[1]: Detected virtualization kvm. [ 14.436709] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 15.930694] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.937943] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 15.954312] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 15.968304] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 15.974323] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 15.989285] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.001920] systemd[1]: Stopped target Switch Root. [ OK ] Stopped target Switch Root. [ OK ] Listening on udev Kernel Socket. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Create list of required st…ce nodes for the current kernel... Mounting Huge Pages File System... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Initrd Root File System. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-serial\x2dgetty.slice. Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ 16.266567] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on Process Core Dump Socket. [ OK ] Stopped target Initrd File Systems. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Mounting POSIX Message Queue File System... Starting Apply Kernel Variables... [ OK ] Reached target rpc_pipefs.target. Mounting Kernel Debug File System... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Created slice system-getty.slice. Starting Remount Root and Kernel File Systems... [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Huge Pages File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Kernel Debug File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 16.959443] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 17.283187] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 17.306546] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 17.586127] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 17.618060] EDAC sbridge: Ver: 1.1.2 [ 20.201076] Key type dns_resolver registered [ 20.720712] NFS: Registering the id_resolver key type [ 20.725646] Key type id_resolver registered [ 20.728527] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Mark the need to relabel after reboot. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... Starting Login Service... [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Started OpenSSH server daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. [ OK ] Started Authorization Manager. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg317-server login: [ 44.834715] libcfs: loading out-of-tree module taints kernel. [ 44.851312] Key type ._llcrypt registered [ 44.852507] Key type .llcrypt registered [ 44.887423] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 51.691779] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 52.219339] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 52.224251] alg: No test for adler32 (adler32-zlib) [ 53.195424] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 53.453051] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 55.063109] Key type lgssc registered [ 55.567681] Lustre: Echo OBD driver; http://www.lustre.org/ [ 61.713027] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 74.380387] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 78.481543] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 78.488344] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 79.577647] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 79.591256] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 79.629096] Lustre: lustre-MDT0000: new disk, initializing [ 79.657514] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 79.666137] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 80.887541] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 85.701290] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 85.735212] Lustre: 6465:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 85.748082] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 85.748610] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 85.750082] Lustre: Skipped 1 previous similar message [ 85.790891] Lustre: lustre-MDT0001: new disk, initializing [ 85.808650] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 85.817100] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 85.821374] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 86.917291] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 89.080908] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 91.962560] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 92.045574] Lustre: lustre-OST0000: new disk, initializing [ 92.046853] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 92.061438] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 93.892537] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 94.825938] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 94.829943] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 94.840187] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 99.201889] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 99.248220] Lustre: lustre-OST0001: new disk, initializing [ 99.249754] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 99.268798] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 100.525105] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 100.529844] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 100.547611] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 101.124022] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 106.726334] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 111.145898] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 117.994377] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing check_logdir /tmp/testlogs/ [ 119.517532] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing yml_node [ 120.877182] Lustre: DEBUG MARKER: Client: 2.17.50.193 [ 121.693048] Lustre: DEBUG MARKER: MDS: 2.17.50.193 [ 122.507710] Lustre: DEBUG MARKER: OSS: 2.17.50.193 [ 123.011630] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Mar 19 13:29:16 EDT 2026 [ 128.705819] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 129.165599] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 141.791981] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 141.792576] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 141.795535] Lustre: Skipped 2 previous similar messages [ 141.797332] Lustre: Skipped 1 previous similar message [ 146.912487] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 146.914475] Lustre: Skipped 5 previous similar messages [ 152.031631] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 152.033190] Lustre: Skipped 3 previous similar messages [ 155.103125] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 155.171512] Lustre: server umount lustre-MDT0000 complete [ 156.421640] LustreError: 6459:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941391 with bad export cookie 9191548175630687484 [ 156.423213] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 156.426367] LustreError: 6459:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 157.151593] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 157.151839] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 157.155431] Lustre: Skipped 2 previous similar messages [ 162.597014] Lustre: server umount lustre-MDT0001 complete [ 178.143239] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 178.173658] Lustre: server umount lustre-OST0000 complete [ 185.427712] Lustre: server umount lustre-OST0001 complete [ 187.424709] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 190.656303] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 202.592744] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 202.688839] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 202.702427] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 202.743284] Lustre: lustre-MDT0000: new disk, initializing [ 202.768224] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 202.774020] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 204.027346] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 208.193225] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 208.233434] Lustre: 14930:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 208.350375] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 209.685389] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 212.769192] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 213.961056] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 216.294123] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 216.418229] Lustre: lustre-OST0000: new disk, initializing [ 216.419627] Lustre: Skipped 1 previous similar message [ 216.421354] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 216.422981] Lustre: Skipped 2 previous similar messages [ 216.457416] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 216.459487] Lustre: Skipped 1 previous similar message [ 217.784350] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 217.787499] Lustre: Skipped 1 previous similar message [ 217.789946] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 217.819196] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 218.415356] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 221.502224] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 222.886733] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 222.962287] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 224.326018] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 224.409160] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 228.324561] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 228.324763] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 228.326841] LustreError: Skipped 1 previous similar message [ 228.330959] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 228.333834] Lustre: Skipped 4 previous similar messages [ 231.192604] Lustre: server umount lustre-OST0000 complete [ 233.441430] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 233.444850] Lustre: Skipped 2 previous similar messages [ 238.626854] Lustre: server umount lustre-MDT0000 complete [ 239.896667] LustreError: 14924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941474 with bad export cookie 9191548175630688989 [ 239.899671] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 239.900718] LustreError: 14924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 240.036943] Lustre: server umount lustre-MDT0001 complete [ 241.678672] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 13:31:15 (1773941475) [ 243.849576] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 243.988084] LustreError: 18784:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 243.994814] LustreError: 18784:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 244.011418] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 245.142306] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 247.685764] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 249.052489] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 250.818716] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 251.982509] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 254.207044] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 256.099417] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 257.838456] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 275.327321] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 279.009036] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 279.010873] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 279.013515] Lustre: Skipped 2 previous similar messages [ 279.015154] Lustre: Skipped 5 previous similar messages [ 284.727842] Lustre: server umount lustre-MDT0000 complete [ 285.942134] LustreError: 18767:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941520 with bad export cookie 9191548175630689871 [ 285.944835] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 285.945635] LustreError: 18767:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 286.057120] Lustre: server umount lustre-MDT0001 complete [ 297.833420] Lustre: server umount lustre-OST0000 complete [ 304.496739] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 307.939484] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 308.092445] LustreError: 22828:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 308.096962] LustreError: 22828:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 308.108822] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 308.112288] Lustre: Skipped 2 previous similar messages [ 309.330748] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 312.079829] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 313.470698] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 314.480324] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 316.633498] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 318.662575] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 321.528854] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 321.603854] Lustre: lustre-OST0001: new disk, initializing [ 321.606277] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 323.397146] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 323.400757] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 323.434939] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 323.608439] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 328.291132] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 335.839672] Lustre: Setting parameter general.obdfilter.*.client_cache_count=256 in log params [ 335.841817] Lustre: Skipped 1 previous similar message [ 338.912854] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 338.915370] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 338.916068] Lustre: Skipped 2 previous similar messages [ 338.917587] Lustre: Skipped 5 previous similar messages [ 344.893673] Lustre: server umount lustre-MDT0000 complete [ 346.634550] LustreError: 22808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941581 with bad export cookie 9191548175630690711 [ 346.638931] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 346.643676] LustreError: 22808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 346.791066] Lustre: server umount lustre-MDT0001 complete [ 359.366988] Lustre: server umount lustre-OST0000 complete [ 371.037275] Lustre: server umount lustre-OST0001 complete [ 376.713783] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 380.967967] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 381.106233] LustreError: 28078:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 381.126649] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 381.128799] Lustre: Skipped 3 previous similar messages [ 382.511770] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 385.998108] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 387.517601] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 388.728229] Lustre: 29191:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 391.588397] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 393.637499] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 395.814683] LustreError: 29547:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 396.760409] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 398.725899] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 412.430676] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 413.622818] Lustre: 31066:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 421.856103] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 421.858369] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 421.861687] Lustre: Skipped 1 previous similar message [ 421.863383] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 421.864919] Lustre: Skipped 4 previous similar messages [ 426.540329] Lustre: server umount lustre-MDT0000 complete [ 428.005780] LustreError: 28079:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 428.011224] LustreError: 28079:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 428.021369] LustreError: 29194:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941662 with bad export cookie 9191548175630692006 [ 428.023776] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 428.025450] LustreError: 29194:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 428.147365] Lustre: server umount lustre-MDT0001 complete [ 440.270812] Lustre: server umount lustre-OST0000 complete [ 451.991935] Lustre: server umount lustre-OST0001 complete [ 455.041990] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 13:34:48 (1773941688) [ 464.935705] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 468.701829] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 468.830982] LustreError: 33846:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 470.031522] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 472.954724] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 474.558720] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 475.550726] Lustre: 34960:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 478.272215] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 480.256896] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 483.816305] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 485.798666] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 489.157190] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 490.435177] Lustre: 36812:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 498.655881] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 498.659677] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 498.664842] Lustre: Skipped 3 previous similar messages [ 503.018205] Lustre: server umount lustre-MDT0000 complete [ 504.290859] LustreError: 34563:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 504.298654] LustreError: 34563:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 504.460555] LustreError: 33828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941739 with bad export cookie 9191548175630693119 [ 504.465986] LustreError: 33828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 504.467389] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 504.590194] Lustre: server umount lustre-MDT0001 complete [ 515.596448] Lustre: server umount lustre-OST0000 complete [ 527.276519] Lustre: server umount lustre-OST0001 complete [ 530.958188] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 13:36:04 (1773941764) [ 537.862858] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 541.826137] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 541.993068] LustreError: 38933:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 542.014128] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 542.015924] Lustre: Skipped 7 previous similar messages [ 543.626208] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 546.620953] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 548.022548] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 548.958315] Lustre: 40044:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 551.085808] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 553.209059] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 556.120373] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 558.048749] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 561.654624] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 568.487196] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 572.383787] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 572.385993] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 572.389108] Lustre: Skipped 3 previous similar messages [ 572.390826] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 572.392447] Lustre: Skipped 9 previous similar messages [ 575.644612] Lustre: server umount lustre-MDT0000 complete [ 576.838094] LustreError: 38915:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941811 with bad export cookie 9191548175630694225 [ 576.841772] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 576.842879] LustreError: 38915:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 591.327089] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 591.413494] Lustre: server umount lustre-MDT0001 complete [ 594.968953] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 601.568076] LustreError: 3618:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9f2477b58000 x1860112260316288/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 603.339986] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 606.945476] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 608.729369] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 610.747655] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 617.455052] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 621.675198] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 10 sec [ 623.080482] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 623.607814] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 627.689820] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 631.105228] Lustre: server umount lustre-MDT0000 complete [ 632.803769] LustreError: 42773:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 632.809161] LustreError: 42773:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 16 previous similar messages [ 632.819067] LustreError: 39663:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941867 with bad export cookie 9191548175630695366 [ 632.824704] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 632.952839] Lustre: server umount lustre-MDT0001 complete [ 645.125879] Lustre: server umount lustre-OST0000 complete [ 656.691890] Lustre: server umount lustre-OST0001 complete [ 659.657265] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 13:38:13 (1773941893) [ 665.233741] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 669.142334] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 670.670524] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 673.724911] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 675.396387] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 676.794260] Lustre: 47405:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 676.800384] Lustre: 47405:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message [ 679.633745] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 682.268099] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 685.701335] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 688.003463] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 691.519770] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 698.131096] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 704.480545] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 704.484887] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 704.491646] Lustre: Skipped 9 previous similar messages [ 709.304974] Lustre: server umount lustre-MDT0000 complete [ 710.733350] LustreError: 49385:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773941945 with bad export cookie 9191548175630696185 [ 710.739449] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 710.740706] LustreError: 49385:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 710.848483] Lustre: server umount lustre-MDT0001 complete [ 722.641252] Lustre: server umount lustre-OST0000 complete [ 733.547457] Lustre: server umount lustre-OST0001 complete [ 737.778704] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 13:39:31 (1773941971) [ 738.547297] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 739.036275] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 13:39:32 (1773941972) [ 743.451978] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 746.792647] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 755.399265] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 755.553298] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 755.601574] Lustre: lustre-MDT0000: new disk, initializing [ 755.642271] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 757.069102] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 760.570736] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 763.366267] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 765.376558] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 765.385641] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 765.626346] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 768.946326] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 770.042725] Lustre: DEBUG MARKER: create test files [ 780.769535] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 784.599721] Lustre: server umount lustre-OST0000 complete [ 786.522542] Lustre: server umount lustre-MDT0000 complete [ 790.548621] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 791.504007] Key type lgssc unregistered [ 791.644697] LNet: 54776:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 791.646885] LNetError: 54776:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 791.654477] LNet: Removed LNI 192.168.203.117@tcp [ 792.103155] Key type .llcrypt unregistered [ 792.106346] Key type ._llcrypt unregistered [ 804.691553] Key type ._llcrypt registered [ 804.692755] Key type .llcrypt registered [ 804.726977] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 805.072208] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 805.111779] alg: No test for adler32 (adler32-zlib) [ 805.985237] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 806.061413] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 807.639151] Key type lgssc registered [ 808.139845] Lustre: Echo OBD driver; http://www.lustre.org/ [ 811.232875] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 811.240410] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 812.389728] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 813.810340] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 815.686195] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 818.800413] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 818.982952] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 821.119412] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 823.076134] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:88 to 0x240000400:129) [ 823.103741] Lustre: 57878:0:(osd_internal.h:1455:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 823.106371] Lustre: 57878:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 823.108429] Lustre: 57878:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 823.110428] Lustre: 57878:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 823.112573] Lustre: 57878:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 823.114614] Lustre: 57878:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 823.138217] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 826.518131] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 828.780274] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 833.506238] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 833.506675] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 833.523351] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 837.354553] Lustre: server umount lustre-OST0000 complete [ 839.266718] Lustre: server umount lustre-MDT0000 complete [ 842.700455] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 843.733210] Key type lgssc unregistered [ 843.859311] LNet: 58837:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 843.862649] LNetError: 58837:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 843.873363] LNet: Removed LNI 192.168.203.117@tcp [ 844.220809] Key type .llcrypt unregistered [ 844.223070] Key type ._llcrypt unregistered [ 855.835334] Key type ._llcrypt registered [ 855.837247] Key type .llcrypt registered [ 855.879341] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 856.213755] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 856.241392] alg: No test for adler32 (adler32-zlib) [ 857.124360] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 857.221647] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 858.807230] Key type lgssc registered [ 859.227134] Lustre: Echo OBD driver; http://www.lustre.org/ [ 861.812883] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 861.820167] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 862.962366] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 864.102514] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 865.758111] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 868.643367] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 868.783943] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 871.229367] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 872.868251] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 872.892847] Lustre: 61515:0:(osd_internal.h:1455:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 872.896015] Lustre: 61515:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 872.898696] Lustre: 61515:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 872.901429] Lustre: 61515:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 872.904098] Lustre: 61515:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 872.906538] Lustre: 61515:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 873.485274] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 876.619663] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 883.170927] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 883.170987] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 883.179970] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 885.079825] Lustre: server umount lustre-OST0000 complete [ 887.002356] Lustre: server umount lustre-MDT0000 complete [ 890.900407] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 891.857609] Key type lgssc unregistered [ 891.987394] LNet: 62948:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 891.990909] LNetError: 62948:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 892.003284] LNet: Removed LNI 192.168.203.117@tcp [ 892.352107] Key type .llcrypt unregistered [ 892.353680] Key type ._llcrypt unregistered [ 898.352628] Key type ._llcrypt registered [ 898.353695] Key type .llcrypt registered [ 898.385914] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 904.760332] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 905.153070] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 905.189738] alg: No test for adler32 (adler32-zlib) [ 906.067738] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 906.167709] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 907.759248] Key type lgssc registered [ 908.224932] Lustre: Echo OBD driver; http://www.lustre.org/ [ 921.391117] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 921.397924] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 922.493702] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 922.504881] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 922.550415] Lustre: lustre-MDT0000: new disk, initializing [ 922.575646] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 922.582886] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 923.960375] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 928.677385] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 928.750220] Lustre: 66042:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 928.788898] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 928.792820] Lustre: Skipped 1 previous similar message [ 928.839351] Lustre: lustre-MDT0001: new disk, initializing [ 928.887233] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 928.906469] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 928.912125] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 930.437326] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 933.721215] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 935.026709] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 938.280623] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 938.421910] Lustre: lustre-OST0000: new disk, initializing [ 938.425863] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 938.475443] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 940.847925] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 944.220943] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 945.930824] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 947.206539] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 947.215110] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 947.253613] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 948.106341] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 949.578867] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 949.642295] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 952.289592] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 952.290473] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 952.294289] LustreError: Skipped 1 previous similar message [ 952.301260] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 952.305962] Lustre: Skipped 1 previous similar message [ 956.300183] Lustre: server umount lustre-OST0000 complete [ 959.968490] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 959.973342] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 959.980650] Lustre: Skipped 1 previous similar message [ 959.984053] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 962.528883] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 962.529953] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 963.613226] Lustre: server umount lustre-MDT0000 complete [ 965.326235] LustreError: 66033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942200 with bad export cookie 1789929102745933377 [ 965.332317] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 965.335399] LustreError: 66033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 965.488686] Lustre: server umount lustre-MDT0001 complete [ 969.594663] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 13:43:23 (1773942203) [ 973.843753] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 988.423753] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 991.936274] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1006.683662] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1006.793665] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1006.803949] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1006.839342] Lustre: lustre-MDT0000: new disk, initializing [ 1006.869270] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1006.876316] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1008.367215] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1013.378501] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1013.419383] Lustre: 73613:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1013.443398] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1013.445228] Lustre: Skipped 1 previous similar message [ 1013.481877] Lustre: lustre-MDT0001: new disk, initializing [ 1013.511145] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1013.520897] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1013.523739] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1014.984684] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1018.525416] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1019.888480] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1022.758912] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1022.885295] Lustre: lustre-OST0000: new disk, initializing [ 1022.890545] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1022.928056] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1024.880323] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1028.521935] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1028.610698] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1028.618025] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1028.663476] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1030.205923] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1030.278449] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1031.693775] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1031.758837] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1033.698038] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1033.698109] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1033.701942] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1033.703199] LustreError: Skipped 1 previous similar message [ 1033.707152] Lustre: Skipped 2 previous similar messages [ 1034.468707] Lustre: server umount lustre-OST0000 complete [ 1038.818091] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1038.819322] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1038.825870] Lustre: Skipped 2 previous similar messages [ 1038.832210] Lustre: Skipped 1 previous similar message [ 1042.106306] Lustre: server umount lustre-MDT0000 complete [ 1043.918609] LustreError: 76747:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942278 with bad export cookie 1789929102745934259 [ 1043.922909] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1043.926963] LustreError: 76747:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1044.075956] Lustre: server umount lustre-MDT0001 complete [ 1048.047809] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 13:44:41 (1773942281) [ 1050.734559] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1050.999883] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1052.728774] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1056.224952] LustreError: 77616:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1056.234506] LustreError: 77616:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 1056.787292] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1058.595730] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1061.172057] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1062.804890] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1065.484205] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1067.930617] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1070.279526] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1071.987830] Lustre: 79948:0:(genops.c:1793:obd_export_evict_by_uuid()) MGS: evicting eb262111-6ae8-4fde-b661-028bab247840 at adminstrative request [ 1072.098320] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1072.101774] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1082.343555] Lustre: MGS: Client eb262111-6ae8-4fde-b661-028bab247840 (at 0@lo) reconnecting [ 1082.347679] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x18d71b09164e1d09 to 0x18d71b09164e1f94 [ 1082.353470] Lustre: MGC192.168.203.117@tcp: Connection restored to 0@lo (at 0@lo) [ 1105.120689] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1105.214353] Lustre: lustre-OST0001: new disk, initializing [ 1105.216224] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1105.250409] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1105.253050] Lustre: Skipped 2 previous similar messages [ 1107.447430] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1110.967309] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1111.894390] Lustre: server umount lustre-OST0001 complete [ 1115.115505] LustreError: 79210:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1115.116943] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1115.123080] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1115.124439] Lustre: Skipped 1 previous similar message [ 1119.440347] Lustre: server umount lustre-OST0000 complete [ 1120.834786] Lustre: server umount lustre-MDT0000 complete [ 1122.018243] LustreError: 77641:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942356 with bad export cookie 1789929102745935764 [ 1122.021629] LustreError: 77641:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1122.022384] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1128.171807] Lustre: server umount lustre-MDT0001 complete [ 1131.894599] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 13:46:05 (1773942365) [ 1132.607250] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1133.309757] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 13:46:06 (1773942366) [ 1134.023895] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1134.762635] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 13:46:08 (1773942368) [ 1135.401240] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1136.316494] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 13:46:09 (1773942369) [ 1136.988454] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1137.826374] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 13:46:11 (1773942371) [ 1138.510345] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1140.844134] loop: module loaded [ 1140.848261] loop0: detected capacity change from 0 to 4294967296 [ 1140.858099] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1141.477051] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1142.658468] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1144.253333] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1154.669061] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1154.682875] LustreError: 84325:0:(obd_config.c:880:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1154.685523] LustreError: 84325:0:(obd_mount.c:217:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1154.687872] LustreError: 84325:0:(tgt_mount.c:2547:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1154.690455] LustreError: 84325:0:(super25.c:186:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1161.731845] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 1165.501267] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1179.055037] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1179.176424] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1179.193857] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1179.240454] Lustre: lustre-MDT0000: new disk, initializing [ 1179.271210] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1179.280206] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1180.890777] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1185.993961] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1186.066120] Lustre: 87150:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1186.248380] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1188.173560] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1191.914068] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1193.715899] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1196.727581] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1199.573462] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1201.679059] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1201.735803] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1203.443761] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1205.234774] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1205.351220] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1207.170904] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1207.296552] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1211.879977] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1211.882692] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1211.884449] LustreError: Skipped 1 previous similar message [ 1211.892115] Lustre: Skipped 1 previous similar message [ 1211.895132] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1211.899030] Lustre: Skipped 1 previous similar message [ 1214.360498] Lustre: server umount lustre-OST0000 complete [ 1216.995404] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1222.342451] Lustre: server umount lustre-MDT0000 complete [ 1224.198390] LustreError: 87144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942458 with bad export cookie 1789929102745936345 [ 1224.205425] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1224.207104] LustreError: 87144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1224.401342] Lustre: server umount lustre-MDT0001 complete [ 1228.487674] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 13:47:42 (1773942462) [ 1231.731898] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1231.899330] LustreError: 91153:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1231.904535] LustreError: 91153:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1233.596578] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1236.961066] LustreError: 91154:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1237.096109] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1238.546840] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1240.454964] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1241.751396] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1244.760426] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1246.758315] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1249.192068] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1251.033909] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1257.331111] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 6 sec [ 1259.065691] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1259.147126] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1262.283115] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1262.361740] Lustre: lustre-OST0001: new disk, initializing [ 1262.363790] Lustre: Skipped 2 previous similar messages [ 1262.366161] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1262.368966] Lustre: Skipped 3 previous similar messages [ 1264.739891] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1268.244402] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1270.260649] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1272.358153] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1272.364931] Lustre: Skipped 2 previous similar messages [ 1272.368302] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1272.418794] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1273.495139] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 3 sec [ 1275.234642] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1275.338191] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1286.453328] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1294.974472] Lustre: Failing over lustre-MDT0000 [ 1295.246462] Lustre: server umount lustre-MDT0000 complete [ 1297.501458] LustreError: 93565:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.17@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1297.511654] LustreError: 93565:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1297.894372] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1297.902635] Lustre: Skipped 5 previous similar messages [ 1307.722134] LustreError: 91149:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.17@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1307.730393] LustreError: 91149:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 11 previous similar messages [ 1311.998050] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1311.999683] LDISKFS-fs (dm-0): recovery complete [ 1312.003491] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1312.053665] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1312.176409] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 1312.178437] Lustre: Skipped 6 previous similar messages [ 1312.208886] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1312.843387] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1312.845375] Lustre: 91149:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1313.661542] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1317.347442] Lustre: 91154:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1317.354995] Lustre: 91154:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 1 previous similar message [ 1317.368682] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1317.397259] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1317.719123] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1318.041385] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1318.044620] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 1318.359096] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1318.363689] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 1318.369291] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1318.375445] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 7 previous similar messages [ 1319.320947] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1319.325681] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 3 previous similar messages [ 1319.639114] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1319.642866] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 3 previous similar messages [ 1320.587969] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1320.598224] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 6 previous similar messages [ 1321.551962] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1321.556299] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 1321.871100] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1321.876244] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 1324.695753] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1324.699127] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 12 previous similar messages [ 1325.641699] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1325.648534] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 1325.967079] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1325.972466] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 1332.848298] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1332.855394] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 25 previous similar messages [ 1333.802479] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1333.808978] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 25 previous similar messages [ 1334.127083] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1334.130778] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 25 previous similar messages [ 1349.119630] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1349.123519] Lustre: 96895:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 51 previous similar messages [ 1350.065278] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1350.068842] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 51 previous similar messages [ 1350.383042] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1350.385420] LustreError: 96895:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 51 previous similar messages [ 1372.271227] Lustre: 96895:0:(ldlm_lib.c:2377:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1372.275104] Lustre: 96895:0:(ldlm_lib.c:2387:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1372.278371] Lustre: 96895:0:(genops.c:1620:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 469cf757-770b-40f1-aec6-f0f55fa90575@192.168.203.17@tcp [ 1372.282392] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1372.284764] Lustre: 96895:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@00000000e1c0434e x1860113146119680/t0(8589934772) o35->469cf757-770b-40f1-aec6-f0f55fa90575@192.168.203.17@tcp:657/0 lens 392/0 e 0 to 0 dl 1773942617 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1372.294742] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1372.300599] Lustre: lustre-MDT0000: Denying connection for new client 469cf757-770b-40f1-aec6-f0f55fa90575 (at 192.168.203.17@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1372.303208] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1372.321508] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1372.321665] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1372.324431] Lustre: Skipped 2 previous similar messages [ 1372.342482] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 1372.342533] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 1378.790272] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1378.793468] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1378.800187] Lustre: Skipped 1 previous similar message [ 1378.803702] Lustre: Skipped 4 previous similar messages [ 1384.203252] Lustre: server umount lustre-OST0000 complete [ 1388.001751] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1389.028931] LustreError: 92748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1389.037068] LustreError: 92748:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 1400.287108] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1400.347187] Lustre: server umount lustre-OST0001 complete [ 1416.159072] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1416.222354] Lustre: server umount lustre-MDT0000 complete [ 1417.488914] LustreError: 96145:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942652 with bad export cookie 1789929102745987543 [ 1417.492061] LustreError: 96145:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1417.493371] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1417.605295] Lustre: server umount lustre-MDT0001 complete [ 1421.249831] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 13:50:54 (1773942654) [ 1424.684649] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1424.687499] Lustre: *** cfs_fail_loc=197, val=0*** [ 1440.159382] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1445.279520] LustreError: 98853:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.117@tcp: failed processing log, type 4: rc = -110 [ 1450.405450] Lustre: *** cfs_fail_loc=197, val=0*** [ 1450.406637] Lustre: Skipped 65 previous similar messages [ 1473.356337] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1476.034256] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1477.049461] Lustre: server umount lustre-OST0000 complete [ 1480.908543] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 13:51:54 (1773942714) [ 1495.320135] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1495.456153] LustreError: 100356:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1495.460645] LustreError: 100356:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1496.850704] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1500.160612] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1502.263177] LustreError: 100389:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1502.266764] LustreError: 100389:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1502.269303] LustreError: 100389:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 6, retries 0, failed: rc = -5 [ 1502.376656] Lustre: server umount lustre-MDT0000 complete [ 1514.960826] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 1518.351591] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1533.645978] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1533.726790] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1533.736398] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1533.771579] Lustre: lustre-MDT0000: new disk, initializing [ 1533.802440] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1535.263726] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1540.182477] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1540.236818] Lustre: 104405:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1540.373400] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1541.964136] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1545.890624] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1547.579489] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1550.560924] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1552.937187] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1553.524126] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1556.419187] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1557.785517] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1557.886236] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1559.474726] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1559.579703] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1563.616301] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1563.619935] LustreError: Skipped 1 previous similar message [ 1563.622380] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1563.628241] Lustre: Skipped 4 previous similar messages [ 1563.630869] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1563.634040] Lustre: Skipped 17 previous similar messages [ 1566.564754] Lustre: server umount lustre-OST0000 complete [ 1574.324865] Lustre: server umount lustre-MDT0000 complete [ 1574.368076] LustreError: 105199:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1574.377551] LustreError: 105199:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 1576.046199] LustreError: 105184:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942810 with bad export cookie 1789929102745998148 [ 1576.049093] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1576.050179] LustreError: 105184:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1576.160813] Lustre: server umount lustre-MDT0001 complete [ 1579.862910] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 13:53:33 (1773942813) [ 1583.701689] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 1584.989242] Key type lgssc unregistered [ 1585.133404] LNet: 108473:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1585.138453] LNetError: 108473:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1585.147629] LNet: Removed LNI 192.168.203.117@tcp [ 1585.589595] Key type .llcrypt unregistered [ 1585.591961] Key type ._llcrypt unregistered [ 1593.150304] Key type ._llcrypt registered [ 1593.152747] Key type .llcrypt registered [ 1593.215167] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 1601.245117] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1601.675208] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1601.714976] alg: No test for adler32 (adler32-zlib) [ 1602.599447] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 1602.701907] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 1604.287109] Key type lgssc registered [ 1604.724610] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1623.670902] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1623.682121] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1624.801746] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1624.813486] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1624.855706] Lustre: lustre-MDT0000: new disk, initializing [ 1624.880807] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1624.887151] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1626.211748] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1631.477078] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1631.605401] Lustre: lustre-OST0000: new disk, initializing [ 1631.607939] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1631.610330] Lustre: Skipped 1 previous similar message [ 1631.641122] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1633.501705] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1634.385104] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1634.390145] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1634.403041] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1637.655216] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1637.715201] Lustre: lustre-OST0001: new disk, initializing [ 1637.717372] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1637.744162] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1640.183958] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1643.023103] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1643.027793] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1643.035115] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1648.098861] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1648.100439] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1648.106594] Lustre: Skipped 1 previous similar message [ 1650.906338] Lustre: server umount lustre-MDT0000 complete [ 1653.816255] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 1655.402403] LustreError: 112570:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773942890 with bad export cookie 14171679738574228985 [ 1655.404823] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1655.405735] LustreError: 112570:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1655.439839] Lustre: server umount lustre-OST0000 complete [ 1657.018345] Lustre: server umount lustre-OST0001 complete [ 1660.786760] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 13:54:54 (1773942894) [ 1664.640299] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1674.168704] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 13:55:07 (1773942907) [ 1688.632105] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 1692.037905] hrtimer: interrupt took 9896975 ns [ 1693.187233] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1733.664809] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1733.904516] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1733.939882] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1734.015660] Lustre: lustre-MDT0000: new disk, initializing [ 1734.090616] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1734.108387] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1737.573213] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1743.864380] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1743.931832] Lustre: 120092:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1743.966484] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1743.969552] Lustre: Skipped 1 previous similar message [ 1744.014715] Lustre: lustre-MDT0001: new disk, initializing [ 1744.068762] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1744.091670] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1744.099148] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1746.109051] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1750.387896] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1753.070447] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1758.529316] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1758.743244] Lustre: lustre-OST0000: new disk, initializing [ 1758.746609] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1758.815445] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1761.922668] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1764.882643] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1764.886870] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1764.940187] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1766.214826] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1768.274745] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1768.387162] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1770.816499] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1770.980963] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1775.075182] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1775.080083] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1775.084095] Lustre: Skipped 1 previous similar message [ 1775.096498] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1775.102853] Lustre: Skipped 2 previous similar messages [ 1780.193363] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1780.196424] Lustre: Skipped 1 previous similar message [ 1785.313373] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1786.336180] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1786.419704] Lustre: server umount lustre-OST0000 complete [ 1790.432741] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1790.433441] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1790.437576] Lustre: Skipped 1 previous similar message [ 1790.440243] Lustre: Skipped 1 previous similar message [ 1790.441839] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1790.445264] LustreError: Skipped 1 previous similar message [ 1794.362459] Lustre: server umount lustre-MDT0000 complete [ 1796.303601] LustreError: 120083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943030 with bad export cookie 14171679738574230189 [ 1796.308828] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1796.316489] LustreError: 120083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1796.546296] Lustre: server umount lustre-MDT0001 complete [ 1801.375582] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 13:57:14 (1773943034) [ 1805.067381] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1805.289671] LustreError: 124094:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1805.299645] LustreError: 124094:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1805.313620] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1807.243566] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1810.406084] LustreError: 124095:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1812.153076] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1814.680272] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1817.672356] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1819.973202] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1823.293155] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1826.059440] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1828.401184] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1840.282023] Lustre: *** cfs_fail_loc=159, val=0*** [ 1840.284769] Lustre: Skipped 2 previous similar messages [ 1856.603669] Lustre: lustre-MDT0000: Client 180073c1-2e27-468a-8184-5533fb6d0b95 (at 192.168.203.17@tcp) reconnecting [ 1857.407956] Lustre: *** cfs_fail_loc=159, val=0*** [ 1857.410278] Lustre: Skipped 3 previous similar messages [ 1872.992291] Lustre: lustre-MDT0000: Client 180073c1-2e27-468a-8184-5533fb6d0b95 (at 192.168.203.17@tcp) reconnecting [ 1875.938804] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1875.947138] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1875.955894] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1879.013052] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1881.182912] Lustre: server umount lustre-OST0000 complete [ 1884.128442] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1884.132692] Lustre: Skipped 2 previous similar messages [ 1889.331402] Lustre: server umount lustre-MDT0000 complete [ 1891.333256] LustreError: 124074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943126 with bad export cookie 14171679738574231071 [ 1891.334956] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1891.343422] LustreError: 124074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1891.532445] Lustre: server umount lustre-MDT0001 complete [ 1897.081057] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 1898.575466] Key type lgssc unregistered [ 1898.746480] LNet: 127531:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1898.749926] LNetError: 127531:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1898.758584] LNet: Removed LNI 192.168.203.117@tcp [ 1899.159067] Key type .llcrypt unregistered [ 1899.165732] Key type ._llcrypt unregistered [ 1912.368980] Key type ._llcrypt registered [ 1912.370512] Key type .llcrypt registered [ 1912.423666] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 1912.807554] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1912.864028] alg: No test for adler32 (adler32-zlib) [ 1913.766890] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 1913.893620] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 1915.489076] Key type lgssc registered [ 1916.195523] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1920.675318] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1920.696659] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1922.017617] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1923.908531] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1926.741722] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1926.851522] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1928.298695] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1930.248300] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1932.046150] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1934.839023] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1935.013455] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1937.009395] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 1939.341785] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1947.307260] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 1954.879963] Lustre: *** cfs_fail_loc=159, val=0*** [ 1971.299986] Lustre: lustre-MDT0000: Client 3be0cef2-5346-4a2f-949d-2809bff86577 (at 192.168.203.17@tcp) reconnecting [ 1972.104836] Lustre: *** cfs_fail_loc=159, val=0*** [ 1988.703046] Lustre: lustre-MDT0001: Client 3be0cef2-5346-4a2f-949d-2809bff86577 (at 192.168.203.17@tcp) reconnecting [ 1989.365623] Lustre: *** cfs_fail_loc=159, val=0*** [ 1989.370743] Lustre: Skipped 4 previous similar messages [ 2005.597100] Lustre: lustre-MDT0001: Client 3be0cef2-5346-4a2f-949d-2809bff86577 (at 192.168.203.17@tcp) reconnecting [ 2006.927626] Lustre: 131628:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2007.999623] Lustre: *** cfs_fail_loc=159, val=0*** [ 2008.001526] Lustre: Skipped 3 previous similar messages [ 2024.544628] Lustre: lustre-MDT0000: Client cdff4a40-b2ed-4bec-95e3-0ce1e31d0cd4 (at 192.168.203.17@tcp) reconnecting [ 2025.370244] Lustre: *** cfs_fail_loc=159, val=0*** [ 2025.373362] Lustre: Skipped 13 previous similar messages [ 2040.928425] Lustre: lustre-MDT0000: Client cdff4a40-b2ed-4bec-95e3-0ce1e31d0cd4 (at 192.168.203.17@tcp) reconnecting [ 2041.456300] Lustre: 131933:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2044.899336] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2044.902736] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2044.904027] LustreError: Skipped 1 previous similar message [ 2044.913362] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2044.918903] Lustre: Skipped 1 previous similar message [ 2048.737931] Lustre: server umount lustre-OST0000 complete [ 2055.138562] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2055.138703] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2055.139935] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2055.154350] Lustre: Skipped 2 previous similar messages [ 2056.560688] Lustre: server umount lustre-MDT0000 complete [ 2058.349518] LustreError: 128887:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943293 with bad export cookie 15521426910063009062 [ 2058.356736] LustreError: 128887:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2058.357300] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2058.499157] Lustre: server umount lustre-MDT0001 complete [ 2062.291671] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 2063.590616] Key type lgssc unregistered [ 2063.720360] LNet: 132966:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2063.723473] LNetError: 132966:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2063.731622] LNet: Removed LNI 192.168.203.117@tcp [ 2064.084533] Key type .llcrypt unregistered [ 2064.086212] Key type ._llcrypt unregistered [ 2073.765408] Key type ._llcrypt registered [ 2073.767086] Key type .llcrypt registered [ 2073.813805] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2074.104833] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2074.131118] alg: No test for adler32 (adler32-zlib) [ 2075.007039] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 2075.098738] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 2076.695223] Key type lgssc registered [ 2077.237512] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2080.260861] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2080.267345] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2081.472822] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2082.994526] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2086.582266] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2086.733098] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2087.896415] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2090.017964] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2091.617659] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2094.652245] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2094.762127] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2096.808846] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2097.038480] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2099.581744] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2107.051495] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2112.168856] Lustre: 136607:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2112.777960] Lustre: 136656:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2113.286504] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2114.625789] Lustre: 136802:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2114.995742] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2115.001651] Lustre: Skipped 1 previous similar message [ 2115.404715] Lustre: 136900:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2117.601460] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2117.603416] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2117.607064] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2117.608623] Lustre: Skipped 1 previous similar message [ 2122.523992] Lustre: server umount lustre-OST0000 complete [ 2127.841064] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2127.841083] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2127.841650] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2127.847447] Lustre: Skipped 2 previous similar messages [ 2127.851407] LustreError: Skipped 1 previous similar message [ 2130.093096] Lustre: server umount lustre-MDT0000 complete [ 2131.642233] LustreError: 134319:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943366 with bad export cookie 14217437537411241901 [ 2131.645208] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2131.647192] LustreError: 134319:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2131.754357] Lustre: server umount lustre-MDT0001 complete [ 2135.335955] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 2136.435346] Key type lgssc unregistered [ 2136.558432] LNet: 137939:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2136.560663] LNetError: 137939:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2136.568361] LNet: Removed LNI 192.168.203.117@tcp [ 2136.849217] Key type .llcrypt unregistered [ 2136.850272] Key type ._llcrypt unregistered [ 2146.268755] Key type ._llcrypt registered [ 2146.269830] Key type .llcrypt registered [ 2146.317229] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2146.653368] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2146.688624] alg: No test for adler32 (adler32-zlib) [ 2147.565806] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 2147.667063] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 2149.255166] Key type lgssc registered [ 2149.804049] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2153.026934] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2153.034664] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2154.200754] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2155.854962] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2159.720940] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2159.847859] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2161.431420] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2163.560373] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2164.771524] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2166.962289] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2167.068510] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2169.394948] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2170.157953] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 2171.365676] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2178.348487] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 2183.913958] Lustre: *** cfs_fail_loc=159, val=0*** [ 2200.165830] Lustre: lustre-MDT0000: Client e7c90a6a-a28c-43bb-bf3a-5d1a12f0e9c5 (at 192.168.203.17@tcp) reconnecting [ 2204.132815] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2204.134790] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2204.141660] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2204.152616] Lustre: Skipped 1 previous similar message [ 2207.967719] Lustre: server umount lustre-OST0000 complete [ 2211.296424] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2211.302081] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2211.310126] Lustre: Skipped 1 previous similar message [ 2211.313698] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2214.368148] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2214.368639] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2219.488946] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2219.492682] Lustre: Skipped 2 previous similar messages [ 2223.585412] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2223.589629] Lustre: Skipped 1 previous similar message [ 2224.095215] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2224.175301] Lustre: server umount lustre-MDT0000 complete [ 2225.964917] LustreError: 139295:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943460 with bad export cookie 8866769563016581543 [ 2225.971046] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2225.971985] LustreError: 139295:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2226.097369] Lustre: server umount lustre-MDT0001 complete [ 2230.419066] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 2231.492561] Key type lgssc unregistered [ 2231.646697] LNet: 142642:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2231.651811] LNetError: 142642:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2231.668670] LNet: Removed LNI 192.168.203.117@tcp [ 2232.128035] Key type .llcrypt unregistered [ 2232.130214] Key type ._llcrypt unregistered [ 2242.660077] Key type ._llcrypt registered [ 2242.661338] Key type .llcrypt registered [ 2242.710934] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2243.117527] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2243.124429] alg: No test for adler32 (adler32-zlib) [ 2243.973414] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 2244.055558] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 2245.639194] Key type lgssc registered [ 2246.095879] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2249.557182] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2249.568897] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2250.766645] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2252.447235] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2255.955636] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2256.104375] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2257.473845] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2259.853829] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2261.694545] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2264.921619] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2265.080980] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2266.091122] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2267.429655] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2269.377401] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2276.328054] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2294.599514] Lustre: lustre-OST0000: evicting 6d16b600-7ce5-4167-ae89-93f5d9b1ab55 (at 192.168.203.17@tcp) by administrative request [ 2294.605595] Lustre: Skipped 1 previous similar message [ 2322.405690] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2322.406666] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2322.408534] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2322.414539] Lustre: Skipped 1 previous similar message [ 2322.424888] LustreError: Skipped 1 previous similar message [ 2325.356732] Lustre: server umount lustre-OST0000 complete [ 2327.520899] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2327.521771] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2327.525280] Lustre: Skipped 1 previous similar message [ 2327.528222] Lustre: Skipped 2 previous similar messages [ 2332.640784] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2332.645142] Lustre: Skipped 1 previous similar message [ 2337.761405] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2337.766704] Lustre: Skipped 1 previous similar message [ 2341.343182] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2341.419784] Lustre: server umount lustre-MDT0000 complete [ 2342.757115] LustreError: 144749:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943577 with bad export cookie 2641013177024990801 [ 2342.759987] LustreError: 144749:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2342.760380] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2342.864472] Lustre: server umount lustre-MDT0001 complete [ 2346.494380] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 2347.542541] Key type lgssc unregistered [ 2347.666371] LNet: 147762:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2347.668487] LNetError: 147762:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2347.678276] LNet: Removed LNI 192.168.203.117@tcp [ 2347.964818] Key type .llcrypt unregistered [ 2347.965977] Key type ._llcrypt unregistered [ 2376.296333] Key type ._llcrypt registered [ 2376.298160] Key type .llcrypt registered [ 2376.354379] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2376.765943] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2376.771744] alg: No test for adler32 (adler32-zlib) [ 2377.611407] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 2377.682695] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 2379.255156] Key type lgssc registered [ 2379.828592] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2383.562761] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2383.574334] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2384.796171] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2386.308728] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2390.319740] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2390.460758] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2391.831894] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2393.977792] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2395.373279] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2398.258563] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2398.459897] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2400.493103] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 2400.749472] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2402.693115] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2409.706748] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 2420.198260] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2420.201461] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2420.204458] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2420.208084] Lustre: Skipped 1 previous similar message [ 2423.590325] Lustre: server umount lustre-OST0000 complete [ 2425.314634] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2425.315543] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2425.322169] Lustre: Skipped 1 previous similar message [ 2425.328926] Lustre: Skipped 2 previous similar messages [ 2430.433148] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2430.435529] Lustre: Skipped 1 previous similar message [ 2431.482780] Lustre: server umount lustre-MDT0000 complete [ 2433.393258] LustreError: 151828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943668 with bad export cookie 3360932629706276919 [ 2433.401583] LustreError: 151828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2433.402642] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2433.554726] Lustre: server umount lustre-MDT0001 complete [ 2437.899470] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 2439.383233] Key type lgssc unregistered [ 2439.545533] LNet: 153412:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2439.552541] LNetError: 153412:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2439.566574] LNet: Removed LNI 192.168.203.117@tcp [ 2440.021786] Key type .llcrypt unregistered [ 2440.024081] Key type ._llcrypt unregistered [ 2451.352737] Key type ._llcrypt registered [ 2451.354386] Key type .llcrypt registered [ 2451.402795] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2451.782519] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2451.798784] alg: No test for adler32 (adler32-zlib) [ 2452.654571] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 2452.738227] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 2454.319177] Key type lgssc registered [ 2454.904621] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2461.673692] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 14:08:15 (1773943695) [ 2468.109536] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 2471.840784] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2487.310355] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2487.324053] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2488.458810] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2488.478048] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2488.538629] Lustre: lustre-MDT0000: new disk, initializing [ 2488.582486] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2488.596379] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2490.567668] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2496.152382] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2496.228584] Lustre: 157593:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2496.275675] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2496.279838] Lustre: Skipped 1 previous similar message [ 2496.329468] Lustre: lustre-MDT0001: new disk, initializing [ 2496.385679] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2496.410809] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2496.417606] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2498.342530] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2502.491415] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2504.258271] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2507.575069] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2507.767717] Lustre: lustre-OST0000: new disk, initializing [ 2507.770930] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2507.820660] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2509.396805] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2509.403695] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2509.465489] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2510.567610] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2514.588216] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2520.040742] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2520.040852] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2520.050382] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2520.052652] LustreError: Skipped 1 previous similar message [ 2525.160771] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2525.164850] Lustre: Skipped 2 previous similar messages [ 2525.741118] Lustre: server umount lustre-OST0000 complete [ 2530.274553] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2530.275729] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2530.280326] Lustre: Skipped 2 previous similar messages [ 2530.286336] Lustre: Skipped 1 previous similar message [ 2533.767743] Lustre: server umount lustre-MDT0000 complete [ 2535.442989] LustreError: 157586:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773943770 with bad export cookie 2727197661602210235 [ 2535.450599] LustreError: 157586:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2535.451912] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2535.619297] Lustre: server umount lustre-MDT0001 complete [ 2540.317389] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 2541.974211] Key type lgssc unregistered [ 2542.138670] LNet: 161110:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2542.142492] LNetError: 161110:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2542.150885] LNet: Removed LNI 192.168.203.117@tcp [ 2542.581877] Key type .llcrypt unregistered [ 2542.583069] Key type ._llcrypt unregistered [ 2554.980228] Key type ._llcrypt registered [ 2554.982220] Key type .llcrypt registered [ 2555.023934] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 2555.384393] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2555.404985] alg: No test for adler32 (adler32-zlib) [ 2556.319244] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 2556.457451] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 2558.047166] Key type lgssc registered [ 2558.698943] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2562.785727] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2562.799179] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2564.031415] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2566.033384] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2570.377816] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2570.557169] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2572.530465] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2575.201571] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2576.874214] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2580.084879] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2580.224214] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2583.001950] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 2585.207056] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2588.462469] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 2593.442073] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2593.450532] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2593.455658] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2593.459990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.463356] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2593.841835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.214928] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2594.218052] Lustre: Skipped 1 previous similar message [ 2594.223804] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2594.228070] Lustre: Skipped 1 previous similar message [ 2594.229712] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2594.231762] Lustre: Skipped 1 previous similar message [ 2594.233438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.237880] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2594.240506] Lustre: Skipped 1 previous similar message [ 2594.652297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.105490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.588465] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2595.593117] Lustre: Skipped 2 previous similar messages [ 2595.602746] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2595.615077] Lustre: Skipped 2 previous similar messages [ 2595.619685] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2595.624482] Lustre: Skipped 2 previous similar messages [ 2595.627277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.634820] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2595.639179] Lustre: Skipped 2 previous similar messages [ 2596.096209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.549754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.038598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.408352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.707748] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2597.709581] Lustre: Skipped 4 previous similar messages [ 2597.714701] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2597.718359] Lustre: Skipped 4 previous similar messages [ 2597.720370] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2597.724353] Lustre: Skipped 4 previous similar messages [ 2597.727011] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.733907] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2597.737892] Lustre: Skipped 4 previous similar messages [ 2598.154278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.604827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.066235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.454089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.903147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.349024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.782844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.188649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.576929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.929727] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2601.932342] Lustre: Skipped 9 previous similar messages [ 2601.939391] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2601.944476] Lustre: Skipped 9 previous similar messages [ 2601.946647] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2601.949373] Lustre: Skipped 9 previous similar messages [ 2601.951308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.958418] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2601.961075] Lustre: Skipped 9 previous similar messages [ 2602.365595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.805155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.111804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.422576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.762916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.215810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.652976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.078150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.559793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.958143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.366556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.821436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.274895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.718246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.166523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.572284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.015297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.440397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.829562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.283616] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2610.286150] Lustre: Skipped 19 previous similar messages [ 2610.292020] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2610.296282] Lustre: Skipped 19 previous similar messages [ 2610.298126] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2610.301777] Lustre: Skipped 19 previous similar messages [ 2610.304266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.310368] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2610.313285] Lustre: Skipped 19 previous similar messages [ 2610.727084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.186645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.622243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.009313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.460384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.945386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.434133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.900227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.371458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.876642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.316744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.769544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.205356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.582775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.025473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.413490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.828859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.204312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.599500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.985410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.392187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.782728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.107534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.424084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.877955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.320746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.713857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.172378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.635225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.084805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.578703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.042825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.512379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.009605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.475301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.928668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.398626] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2626.404214] Lustre: Skipped 36 previous similar messages [ 2626.413705] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2626.424513] Lustre: Skipped 36 previous similar messages [ 2626.428768] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2626.433955] Lustre: Skipped 36 previous similar messages [ 2626.437129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.441641] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2626.444337] Lustre: Skipped 36 previous similar messages [ 2626.894218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.360628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.866499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.328272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.754883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.236249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.667722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.080697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.487465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.889279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.364267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.859738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.269697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.724684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.209456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.679390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.142720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.632502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.088321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.549934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.021666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.457822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.872815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.186127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.572371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.022379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.501440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.955858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.418528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.898520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.335333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.747461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.200173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.530159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.947410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.381952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.813989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.255588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.709441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.149065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.541317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.999278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.376644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.691356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.058762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.470638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.872966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.325875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.741946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.164296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.642666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.053372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.428438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.747288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.013937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.368512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.698304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.018844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.342742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.712770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.071070] LustreError: 162505:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2652.074094] LustreError: 162505:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2652.076270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.448399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.838397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.208209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.568270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.908406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.176919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.530644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.982859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.431800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.875572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.268509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.725722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.164090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.585956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.018377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.398070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.724855] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2658.728012] Lustre: Skipped 77 previous similar messages [ 2658.736534] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2658.743132] Lustre: Skipped 77 previous similar messages [ 2658.744793] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2658.747675] Lustre: Skipped 77 previous similar messages [ 2658.749572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.755369] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2658.757881] Lustre: Skipped 77 previous similar messages [ 2659.171674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.627774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.043378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.365600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.830908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.276965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.693216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.134103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.555591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.985395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.301631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.598398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.976868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.383992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.815320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.263825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.726365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.165580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.628945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.123817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.459692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.849609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.287751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.693278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.153076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.592411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.983638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.425630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.894729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.346113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.805677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.304142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.738851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.161530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.620642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.066449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.504432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.942726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.389365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.806583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.232970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.682215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.146134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.603642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.068281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.533071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.994859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.454749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.913239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.403165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.871746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.326153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.804295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2682.209553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2682.680843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2683.035343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2683.445815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2683.904294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2684.367313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2684.824150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2685.279250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2685.722196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2686.013677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2686.288169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2686.670835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2687.153416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2687.594753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2688.050691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2688.504605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2688.937940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2689.380684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2689.766078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2690.107949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2690.493071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2690.921361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2691.284150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2691.714444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2692.190553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2692.645113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2693.052351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2693.509756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2693.974173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2694.420376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2694.889871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2695.375596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2695.787653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2696.194040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2696.602271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2696.894278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2697.184782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2697.511508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2697.931710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2698.338455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2698.757065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2699.208833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2699.653057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2700.077115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2700.475775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2700.846942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2701.259672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2701.647577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2702.110604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2702.597029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2702.982876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2703.411222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2703.903297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2704.309964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2704.705232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2705.084270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2705.474189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2705.960829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2706.435576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2706.827667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2707.282307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2707.793867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2708.271181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2708.742668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2709.268467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2709.735198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2710.231409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2710.737876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2711.212822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2711.669699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2712.122156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2712.613887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2712.994473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2713.370757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2713.766286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2714.138528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2714.553053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2714.997540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2715.450501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2715.922222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2716.343491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2716.805370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2717.274630] LustreError: 162505:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2717.281165] LustreError: 162505:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2717.282179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2717.743866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2718.174554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2718.665548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2719.124250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2719.586212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2720.012740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2720.469452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2720.923796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2721.415933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2721.867405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2722.327745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2722.751183] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2722.753125] Lustre: Skipped 147 previous similar messages [ 2722.757844] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2722.760767] Lustre: Skipped 147 previous similar messages [ 2722.762097] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2722.763690] Lustre: Skipped 147 previous similar messages [ 2722.764911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2722.772434] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2722.774254] Lustre: Skipped 147 previous similar messages [ 2723.159905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2723.550140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2723.889978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2724.237291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2724.586762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2724.970539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2725.368338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2725.734412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2726.089974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2726.397401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2726.694610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2727.100432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2727.589557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2728.055812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2728.510462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2728.983372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2729.448236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2729.898057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2730.375160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2730.815881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2731.271981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2731.759502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2732.216963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2732.670452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2733.152876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2733.598507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2733.965079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2734.248981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2734.539639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2734.816904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2735.097966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2735.392958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2735.690135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2735.993166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2736.303286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2736.646944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2736.969832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2737.303742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2737.645034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2737.977346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2738.314507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2738.654792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2738.982780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2739.352159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2739.693173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2740.049482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2740.389132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2740.743133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2741.147714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2741.579374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2741.972824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2742.357065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2742.753736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2743.150324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2743.516647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2743.888563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2744.276415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2744.657898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2745.045294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2745.417435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2745.772694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.146697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.503276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.849107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.212626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.593812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.973939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.343835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.721604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.114450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.532777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.919388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.305163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.720301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.118543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.509757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.935185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2752.347523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2752.746680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.149753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.553371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.898503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2754.255644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2754.609708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.000112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.417665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.822855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.184392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.575242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.958189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.330657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.722558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.127612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.544787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.956458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.340276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.762354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.160735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.543739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.938152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.330060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.735879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.124509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.508246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.912820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2763.306479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2763.695879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.054757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.444084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.831403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.176305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.486191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.810230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.114748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.385078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.658932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.946773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.242091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.523697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.814219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.114549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.392614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.665094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.946188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.224606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.510606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.806796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.073951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.349044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.634840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.898693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.172915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.453911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.739392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.017293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.305461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.592383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.870092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.149506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.454705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.760522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.083029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.399318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.708316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.033068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.361607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.700595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.987456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.266455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.559089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.839453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.110366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.381523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.650687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.925984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.200386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.497388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.797951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.094465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.379522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.669362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.944895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.222014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.486754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.761852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.053982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.330227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.612520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.885132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.154527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.443706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.744438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.033857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.332628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.626610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.917350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.214739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.530518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.833035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.135772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.438302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.751386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.043741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.361776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.667481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.985782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.305039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.608770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.925944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.270709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.582958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.884672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.180948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.500238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.803359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.099606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.401331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.702482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.989633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.291039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.593387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.916666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.227325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.537428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.845317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.161982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.466347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.769892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.088530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.407875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.715538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.029915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.367335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.723166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.027197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.346855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.680473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.013083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.320250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.642809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.959265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.291837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.610319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.926083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.254720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.621819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.938584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.247785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.552733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.881083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.180698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.504512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.823584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.149588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.464544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.776428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.109893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.423975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.752154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.064950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.385295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.712759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.030836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.341690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.658425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.991891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.315653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.622417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.976319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.341121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.666263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.992763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.324201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.669905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.999077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.310688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.596271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.893684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.170616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.436633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.713937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.020778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.330645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.651413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.970477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.301183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.623389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.925357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.207223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.492506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.785964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.107820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.429081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.745590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.033926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.343736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.660873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.974569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.274528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.582888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.877358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.193515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.490195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.791034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.104285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.433271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.749586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.037402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.331809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.647161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.956881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2820.262809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2820.584556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2820.912126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.224236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.540749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.867859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.200858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.507519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.825321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.156257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.514077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.835054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.150544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.454581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.764116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.064886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.373394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.676308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.036513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.396957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.794284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.201518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.552175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.928819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.292689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.683882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.064667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.475287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.867696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2830.310994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2830.773920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.218252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.667446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.136918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.587574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2833.034213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2833.610433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.142191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.654209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.117014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.596782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.992480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2836.363363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2836.767675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.200954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.607334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.063519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.478408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.855593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2839.243688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2839.731901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2840.220498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2840.689547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.157499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.623772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.098822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.519790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.930783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2843.476881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2844.010666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2844.542632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2845.117397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2845.677753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.294457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.819549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2847.267924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2847.858483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.409909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.940209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2849.436213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2849.869232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.258076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.617035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.955173] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2850.957205] Lustre: Skipped 364 previous similar messages [ 2850.962849] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2850.968171] Lustre: Skipped 364 previous similar messages [ 2850.970133] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2850.972565] Lustre: Skipped 364 previous similar messages [ 2850.974430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.979050] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2850.981498] Lustre: Skipped 364 previous similar messages [ 2851.330554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2851.691156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.076387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.460965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.831287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.181359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.505261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.864759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.206065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.547808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.870340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.288937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.670322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.055280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.487237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.864950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.243793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.656733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.051890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.463075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.853221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.222916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.610275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.972246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.345565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.687368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.083618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.456222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.835405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.298723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.676488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.033052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.380583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.738639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.082478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.505311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.902358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2865.266446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2865.653609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.039551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.419577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.836160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2867.211234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2867.586702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.016208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.388638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.758389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.100158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.450366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.790855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.107455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.457088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.768970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.091436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.418978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.742870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.047931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.350731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.662854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.980199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.284197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.609306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.924478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.251088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.545850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.865770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.189304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.503352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.794550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2876.095054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2876.409068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2876.755107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.081560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.411432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.733295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.077632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.393367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.699629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.028983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.359221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.681131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.015778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.345794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.688064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.996690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.306818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.623274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.939744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.259457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.574787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.914211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.267823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.604877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.931282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.247616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.583922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.892179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.193214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.506311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.830326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2886.146412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2886.478178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2886.798203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.131153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.452641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.756563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.058339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.378676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.680844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.984328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.287583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.628650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.978831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2890.316790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2890.666412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.019367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.360135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.701609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.025773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.384789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.744137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.103882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.494220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.826230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.155197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.476438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.838927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.172077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.503700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.815020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.146785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.465928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.779601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.108732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.428062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.760731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.074111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.414165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.772610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.090502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.399439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.715291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.039668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.338778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.669026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.974679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.301067] LustreError: 162505:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2901.304149] LustreError: 162505:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2901.305778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.633748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.954308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.271489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.632798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.974655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.301027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.618623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.947073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.270289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.594651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.910178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.262503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.588745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.904961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.246088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.595721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.922376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.242717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.579939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.940383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.284492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.610200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.932901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.285155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.629093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.940647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.240783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.537648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.854301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.155198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.453266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.780218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.080936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.403085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.712996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.036086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.348874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.673447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.988058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.309224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.624125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.924365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.235286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.550360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.897933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.211847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.523699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.845915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.161291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.466971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.765516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.072348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.370507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.678977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.998143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.322477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.630103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.919859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.219251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.525787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.834814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.144288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.444245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.760654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.068920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.378842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.706404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.046057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.348228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.663185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.972572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.295886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.598479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.909970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.225274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.544737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.848759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.156852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.457843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.773849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.080906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.409270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.750967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.079561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.433632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.785750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.176797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.549055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.905501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.251798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.582458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.907294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.258756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.603837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.931617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.245762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.543652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.847297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.142039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.438040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.745554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.058629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.374049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.688681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.991516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.318501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.637037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.968291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.331726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.657920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.998527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.323901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.641911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.961467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.278253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.584770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.897570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.217210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.546698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.878592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.193634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.510435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.844527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.168795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.498523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.831693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.151073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.489925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.806260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.138368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.467895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.823926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.139441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.452726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.779317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.132664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.443846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.750348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.061177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.383909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.716845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.037596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.362773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.728118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.103457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.446278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.786236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.086104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.399897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.715438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.095187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.447238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.801919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.143083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.478346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.827979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.142385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.465807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.768448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.076715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.406254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.735492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.040499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.338582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.664524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.982256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.280673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.590108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.890074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.213091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.517032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.837475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.157450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.486828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.796798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.088538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.386084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.690789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.978791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.269238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.576704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.889350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2960.192553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2960.495221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3052.691252] LustreError: 164081:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 3052.695291] LustreError: 162505:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 3052.698618] LustreError: 162505:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 1 previous similar message [ 3120.097086] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3120.098205] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3120.099504] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3120.100721] Lustre: Skipped 332 previous similar messages [ 3121.785164] Lustre: server umount lustre-OST0000 complete [ 3123.214959] Lustre: server umount lustre-MDT0000 complete [ 3123.679769] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3123.682333] LustreError: 163197:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3123.686479] LustreError: 163197:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3124.443235] LustreError: 216420:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944359 with bad export cookie 14865012722908529351 [ 3124.446616] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3124.447891] LustreError: 216420:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3126.572199] Lustre: server umount lustre-MDT0001 complete [ 3130.014362] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 3131.025915] Key type lgssc unregistered [ 3131.162311] LNet: 217152:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3131.164468] LNetError: 217152:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3131.174282] LNet: Removed LNI 192.168.203.117@tcp [ 3131.469974] Key type .llcrypt unregistered [ 3131.471017] Key type ._llcrypt unregistered [ 3140.394380] Key type ._llcrypt registered [ 3140.395546] Key type .llcrypt registered [ 3140.431787] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3140.724062] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3140.730427] alg: No test for adler32 (adler32-zlib) [ 3141.581912] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 3141.664156] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 3143.247134] Key type lgssc registered [ 3143.643910] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3146.209819] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3146.218249] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3147.370518] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3148.688124] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3151.684844] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3151.825396] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3153.234645] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3155.163794] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3156.386512] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3158.796094] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3158.916427] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3160.826825] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3162.716780] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3173.286988] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 3176.370050] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3176.957316] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3176.962496] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3176.966490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3176.970392] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3176.970414] LustreError: 218545:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 3178.464700] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3178.466810] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3178.471672] Lustre: Skipped 1 previous similar message [ 3179.601291] Lustre: lustre-OST0000: Not available for connect from 192.168.203.17@tcp (stopping) [ 3179.603509] Lustre: Skipped 1 previous similar message [ 3179.668588] Lustre: server umount lustre-OST0000 complete [ 3197.047101] LustreError: 218545:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 3207.886673] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3208.014934] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3209.851969] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3211.546209] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3219.299341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3219.303815] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3219.303868] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3220.202362] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 8 sec [ 3221.395551] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8b6603777800.ost_server_uuid 50 [ 3221.891328] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8b6603777800.ost_server_uuid in FULL state after 0 sec [ 3224.546260] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3224.546834] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3224.550818] Lustre: Skipped 1 previous similar message [ 3224.554565] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3229.005926] Lustre: server umount lustre-OST0000 complete [ 3233.759876] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3233.763860] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3233.770603] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3233.773402] Lustre: Skipped 1 previous similar message [ 3236.371411] Lustre: server umount lustre-MDT0000 complete [ 3237.610211] LustreError: 218505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944472 with bad export cookie 7063884057891920662 [ 3237.613576] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3237.615290] LustreError: 218505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3237.723538] Lustre: server umount lustre-MDT0001 complete [ 3241.261142] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 3242.275678] Key type lgssc unregistered [ 3242.408317] LNet: 223194:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3242.411629] LNetError: 223194:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3242.425340] LNet: Removed LNI 192.168.203.117@tcp [ 3242.720110] Key type .llcrypt unregistered [ 3242.721108] Key type ._llcrypt unregistered [ 3254.091198] Key type ._llcrypt registered [ 3254.092469] Key type .llcrypt registered [ 3254.135728] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3254.478238] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3254.498743] alg: No test for adler32 (adler32-zlib) [ 3255.358622] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 3255.448474] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 3257.031232] Key type lgssc registered [ 3257.431088] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3260.525235] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3260.530693] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3261.679853] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3262.998881] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3265.736175] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3265.851606] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3267.135346] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3268.048723] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 3270.198700] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3270.340755] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3271.398202] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 3272.361460] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3275.219607] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3275.284735] Lustre: lustre-OST0001: new disk, initializing [ 3275.286745] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3275.318624] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3275.747993] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3275.751518] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3275.784481] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3277.235458] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3282.678832] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3287.429252] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 3301.855870] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3301.858932] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3301.863730] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3302.370164] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3302.371110] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3302.372847] Lustre: Skipped 1 previous similar message [ 3302.378493] Lustre: Skipped 1 previous similar message [ 3305.956281] Lustre: server umount lustre-MDT0000 complete [ 3307.234939] LustreError: 228071:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944541 with bad export cookie 362165911224781718 [ 3307.238072] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3307.238770] LustreError: 228071:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3307.244271] LustreError: 225601:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 3307.356788] Lustre: server umount lustre-MDT0001 complete [ 3318.856353] Lustre: server umount lustre-OST0000 complete [ 3330.333892] Lustre: server umount lustre-OST0001 complete [ 3336.626312] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3340.184402] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3340.351816] LustreError: 230214:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3340.360106] LustreError: 230214:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3340.372425] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3341.662552] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3344.504879] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3345.920540] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3346.953093] Lustre: 231319:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3349.217213] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3349.349916] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3349.351650] Lustre: Skipped 1 previous similar message [ 3350.371905] LustreError: 231672:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3350.376656] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49761) [ 3351.301743] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3354.194140] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3355.312166] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 3356.255266] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3359.476056] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3360.673483] Lustre: 233163:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3370.463976] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3370.466478] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3370.470351] Lustre: Skipped 1 previous similar message [ 3370.472416] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3370.475359] Lustre: Skipped 2 previous similar messages [ 3376.098113] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3376.101136] Lustre: Skipped 6 previous similar messages [ 3376.213746] Lustre: server umount mylustre-MDT0000 complete [ 3377.528362] LustreError: 230190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944612 with bad export cookie 362165911224784539 [ 3377.530262] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3377.532733] LustreError: 230190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3377.645490] Lustre: server umount mylustre-MDT0001 complete [ 3388.416879] Lustre: server umount mylustre-OST0000 complete [ 3399.973809] Lustre: server umount mylustre-OST0001 complete [ 3407.392220] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3411.275861] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3411.438462] LustreError: 235450:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3411.469149] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3411.471689] Lustre: Skipped 1 previous similar message [ 3412.756156] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3415.580019] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3416.938898] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3417.881481] Lustre: 236558:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3420.035840] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3421.949153] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3422.179465] LustreError: 236911:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3422.186476] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49793) [ 3425.025475] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3426.154183] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 3427.031712] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3430.236484] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3431.530594] Lustre: 238399:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3441.633164] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3441.635346] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3441.637719] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 3441.640136] Lustre: Skipped 5 previous similar messages [ 3441.641865] Lustre: Skipped 1 previous similar message [ 3444.698515] Lustre: server umount tfs-MDT0000 complete [ 3445.972161] LustreError: 235425:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944680 with bad export cookie 362165911224786492 [ 3445.974702] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3445.976329] LustreError: 235425:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3446.086148] Lustre: server umount tfs-MDT0001 complete [ 3457.670456] Lustre: server umount tfs-OST0000 complete [ 3469.210307] Lustre: server umount tfs-OST0001 complete [ 3475.733667] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3478.943451] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3479.115333] LustreError: 240629:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3479.137609] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3479.139685] Lustre: Skipped 3 previous similar messages [ 3480.286115] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3482.870785] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3484.171824] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3485.099480] Lustre: 241735:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3487.168274] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3489.094679] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3489.314958] LustreError: 242087:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3489.318566] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49825) [ 3491.814911] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3492.904811] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 3493.616203] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3496.612410] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3497.769784] Lustre: 243577:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3504.826348] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 14:25:38 (1773944738) [ 3518.435715] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3518.436630] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3518.439828] Lustre: Skipped 3 previous similar messages [ 3518.443011] Lustre: Skipped 5 previous similar messages [ 3522.581493] Lustre: server umount lustre-MDT0000 complete [ 3523.554286] LustreError: 243591:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3523.559228] LustreError: 243591:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3523.756860] LustreError: 243579:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944758 with bad export cookie 362165911224788186 [ 3523.761618] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3528.672600] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3528.676432] Lustre: Skipped 1 previous similar message [ 3529.899443] Lustre: server umount lustre-MDT0001 complete [ 3537.211734] Lustre: server umount lustre-OST0000 complete [ 3544.531463] Lustre: server umount lustre-OST0001 complete [ 3546.389412] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 3549.197633] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3560.650944] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 3560.650944] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3560.650944] [ 3560.659050] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3560.742186] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3560.754336] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3560.794707] Lustre: lustre-MDT0000: new disk, initializing [ 3560.819539] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3560.821848] Lustre: Skipped 3 previous similar messages [ 3560.827989] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3562.136161] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3566.254609] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 3566.254609] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3566.254609] [ 3566.262427] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3566.300791] Lustre: 246732:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3566.324520] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3566.326061] Lustre: Skipped 1 previous similar message [ 3566.367042] Lustre: lustre-MDT0001: new disk, initializing [ 3566.410512] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3566.413957] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3567.680413] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3571.660045] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3571.758492] Lustre: lustre-OST0000: new disk, initializing [ 3571.760207] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3573.431499] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3573.434129] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3573.467969] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3573.511356] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3577.652239] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3577.723382] Lustre: lustre-OST0001: new disk, initializing [ 3577.725662] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3579.652661] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3579.658549] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3579.688240] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3579.781467] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3584.048616] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 14:26:57 (1773944817) [ 3587.716462] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 14:27:01 (1773944821) [ 3599.328071] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3599.328238] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3599.331058] LustreError: Skipped 1 previous similar message [ 3599.336964] Lustre: Skipped 1 previous similar message [ 3599.339638] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3599.343523] Lustre: Skipped 3 previous similar messages [ 3605.183061] Lustre: server umount lustre-OST0000 complete [ 3605.475707] LustreError: 249646:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3605.482095] LustreError: 249646:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3607.519834] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3612.630061] Lustre: server umount lustre-MDT0000 complete [ 3613.727069] LustreError: 249136:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944848 with bad export cookie 362165911224789740 [ 3613.729917] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3613.730906] LustreError: 249136:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 3627.999084] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3628.082691] Lustre: server umount lustre-MDT0001 complete [ 3631.514996] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 3640.981271] Lustre: server umount lustre-OST0001 complete [ 3642.962732] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 3648.866987] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3660.264909] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3660.347417] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3660.358380] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3660.391461] Lustre: lustre-MDT0000: new disk, initializing [ 3660.418548] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3661.717243] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3665.774375] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3665.814574] Lustre: 253594:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3665.913388] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3667.201112] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3670.258965] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3671.442086] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3673.556737] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3675.317915] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3675.354978] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3675.401937] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3678.345317] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3680.736551] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3680.736886] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3680.739407] LustreError: Skipped 1 previous similar message [ 3680.742651] Lustre: Skipped 4 previous similar messages [ 3680.743429] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3680.747133] Lustre: Skipped 10 previous similar messages [ 3686.735694] Lustre: server umount lustre-OST0000 complete [ 3702.239257] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3702.312736] Lustre: server umount lustre-MDT0000 complete [ 3703.639451] LustreError: 253585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944938 with bad export cookie 362165911224791210 [ 3703.643559] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3703.644372] LustreError: 253585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3703.770549] Lustre: server umount lustre-MDT0001 complete [ 3707.172081] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 3708.092510] Key type lgssc unregistered [ 3708.221350] LNet: 256967:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3708.224181] LNetError: 256967:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3708.233326] LNet: Removed LNI 192.168.203.117@tcp [ 3708.523131] Key type .llcrypt unregistered [ 3708.524524] Key type ._llcrypt unregistered [ 3717.808890] Key type ._llcrypt registered [ 3717.809734] Key type .llcrypt registered [ 3717.840802] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3718.135680] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3718.142592] alg: No test for adler32 (adler32-zlib) [ 3718.990208] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 3719.065704] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 3720.647172] Key type lgssc registered [ 3720.987815] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3723.448859] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3723.454699] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3724.601271] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3725.825806] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3728.501111] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3728.614370] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3729.824761] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3731.497056] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3732.626624] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3734.782567] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3734.887343] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3735.909057] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3736.614856] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3738.335699] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3738.669577] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 3741.151796] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3741.154713] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3741.159283] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3744.225458] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3744.225780] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3744.230581] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3745.423917] Lustre: server umount lustre-OST0000 complete [ 3749.344935] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3749.344958] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3749.345739] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3749.345744] Lustre: Skipped 1 previous similar message [ 3749.349926] Lustre: Skipped 1 previous similar message [ 3752.848835] Lustre: server umount lustre-MDT0000 complete [ 3754.065255] LustreError: 258381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773944988 with bad export cookie 12029177512055850282 [ 3754.068650] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3754.069794] LustreError: 258381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3754.177913] Lustre: server umount lustre-MDT0001 complete [ 3757.674925] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 3758.667879] Key type lgssc unregistered [ 3758.795345] LNet: 261630:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3758.797695] LNetError: 261630:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3758.804405] LNet: Removed LNI 192.168.203.117@tcp [ 3759.098536] Key type .llcrypt unregistered [ 3759.099636] Key type ._llcrypt unregistered [ 3765.676132] Key type ._llcrypt registered [ 3765.677418] Key type .llcrypt registered [ 3765.709117] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3766.006631] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3766.037053] alg: No test for adler32 (adler32-zlib) [ 3766.891682] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 3766.979037] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 3768.567202] Key type lgssc registered [ 3768.929458] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3771.682304] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3771.686814] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3787.103313] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3792.223222] LustreError: 262783:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.117@tcp: failed processing log, type 4: rc = -110 [ 3818.847131] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3820.467427] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3822.293133] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3823.047895] Lustre: server umount lustre-OST0000 complete [ 3828.652446] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 3829.595193] Key type lgssc unregistered [ 3829.726372] LNet: 264280:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3829.729407] LNetError: 264280:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3829.737295] LNet: Removed LNI 192.168.203.117@tcp [ 3830.003312] Key type .llcrypt unregistered [ 3830.005085] Key type ._llcrypt unregistered [ 3843.179255] Key type ._llcrypt registered [ 3843.180511] Key type .llcrypt registered [ 3843.213063] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3843.585351] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3843.594197] alg: No test for adler32 (adler32-zlib) [ 3844.437218] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 3844.513806] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 3846.095158] Key type lgssc registered [ 3846.405985] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3850.369619] loop0: detected capacity change from 0 to 204800000 [ 3850.422909] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3850.426368] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3850.533825] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3850.852964] loop0: detected capacity change from 0 to 204800000 [ 3850.903518] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3850.906594] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3851.021489] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3851.341832] loop0: detected capacity change from 0 to 204800000 [ 3851.397306] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3851.400171] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3851.439219] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3851.775970] loop0: detected capacity change from 0 to 204800000 [ 3851.828920] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3852.178969] loop0: detected capacity change from 0 to 204800000 [ 3852.187431] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3853.398888] loop0: detected capacity change from 0 to 204800000 [ 3853.408050] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3854.578165] loop0: detected capacity change from 0 to 204800000 [ 3854.590080] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3855.766743] loop0: detected capacity change from 0 to 204800000 [ 3855.776807] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3857.009274] loop0: detected capacity change from 0 to 204800000 [ 3857.036172] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3857.045556] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3857.090216] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3857.094433] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 3857.097508] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 3857.100634] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 3857.103661] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 3857.106801] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 3857.110090] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 3857.113324] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 3857.117230] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 3857.121157] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 3857.125214] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 3857.129063] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 3857.132570] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 3857.138364] Lustre: 267652:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 3859.791031] Lustre: server umount MGS complete [ 3860.101597] loop0: detected capacity change from 0 to 204800000 [ 3860.138432] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3860.302556] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3860.320796] Lustre: lustre-MDT0000: Aborting client recovery [ 3860.647938] loop1: detected capacity change from 0 to 204800000 [ 3860.682706] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3860.722225] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3860.727420] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 3860.732236] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 3860.736535] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 3860.741616] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 3860.745721] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 3860.752888] Lustre: 268083:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 3860.762965] Lustre: Found index 1 for lustre-MDT0001, updating log [ 3860.840584] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3860.869471] Lustre: lustre-MDT0001: Aborting client recovery [ 3861.179226] loop2: detected capacity change from 0 to 204800000 [ 3861.209943] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3861.245932] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3861.252201] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 3861.258186] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 3861.262655] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 3861.267116] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 3861.271995] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 3861.277174] Lustre: 268164:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 3861.330381] Lustre: Found index 0 for lustre-OST0000, updating log [ 3861.369314] Lustre: lustre-OST0000: Aborting recovery [ 3861.684478] loop3: detected capacity change from 0 to 204800000 [ 3861.721659] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3861.775387] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3861.782025] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 3861.787158] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 3861.791325] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 3861.798390] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 3861.802469] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 3861.806585] Lustre: 268246:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 3861.845508] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3861.847994] Lustre: Skipped 1 previous similar message [ 3867.112787] LustreError: 268027:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 3870.178166] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 3870.178942] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 3870.190827] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 3870.193137] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 3871.202101] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 3871.202128] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 3872.312099] LustreError: 267994:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 235us: rc = -2 [ 3886.560590] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3886.560906] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3886.561134] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3886.563694] Lustre: Skipped 3 previous similar messages [ 3889.562579] Lustre: server umount lustre-MDT0000 complete [ 3889.855603] LustreError: 267977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945124 with bad export cookie 936696816068000839 [ 3889.857076] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3889.858284] LustreError: 267977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3891.679523] LustreError: 267993:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3891.679752] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3891.683285] LustreError: 267993:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3891.683577] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3891.683582] Lustre: Skipped 3 previous similar messages [ 3891.686286] Lustre: Skipped 1 previous similar message [ 3894.689760] LustreError: 267992:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3894.690051] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3894.699453] LustreError: 267992:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3894.700749] Lustre: Skipped 2 previous similar messages [ 3896.051987] Lustre: server umount lustre-MDT0001 complete [ 3902.471989] Lustre: server umount lustre-OST0000 complete [ 3917.279137] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3917.357480] Lustre: server umount lustre-OST0001 complete [ 3920.040955] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 14:32:33 (1773945153) [ 3929.228957] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 3932.973946] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 3944.321191] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3944.414804] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3944.424963] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3944.456473] Lustre: lustre-MDT0000: new disk, initializing [ 3944.477547] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3944.483751] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3945.783133] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3950.078370] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3950.120659] Lustre: 272285:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3950.157346] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3950.157937] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 3950.159035] Lustre: Skipped 1 previous similar message [ 3950.198481] Lustre: lustre-MDT0001: new disk, initializing [ 3950.236332] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3950.251319] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3950.256876] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3951.578512] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3954.550727] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3955.729204] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3957.971083] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3958.068505] Lustre: lustre-OST0000: new disk, initializing [ 3958.072199] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3959.736867] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3959.741399] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3959.773807] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3959.818720] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 3962.752866] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3965.112549] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 3971.323429] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 3977.054124] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4016.098970] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4016.099310] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4016.100210] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4016.102305] Lustre: Skipped 1 previous similar message [ 4019.538177] Lustre: server umount lustre-OST0000 complete [ 4021.217659] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4021.221881] Lustre: Skipped 1 previous similar message [ 4026.336080] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4026.338080] Lustre: Skipped 4 previous similar messages [ 4026.973133] Lustre: server umount lustre-MDT0000 complete [ 4028.248160] LustreError: 273062:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945262 with bad export cookie 936696816068003548 [ 4028.250829] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4028.254778] LustreError: 273062:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4028.383721] Lustre: server umount lustre-MDT0001 complete [ 4031.228811] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4032.553577] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4034.201866] Lustre: server umount MGS complete [ 4037.977077] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4038.124760] LustreError: 277844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4038.131963] LustreError: 277857:0:(qmt_pool.c:1614:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4038.156805] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4038.159730] Lustre: Skipped 1 previous similar message [ 4039.447545] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4042.365401] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4043.876851] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4045.757569] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4047.004360] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4049.340040] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4051.360598] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4053.257301] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4088.288654] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4088.291110] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4088.291324] LustreError: Skipped 1 previous similar message [ 4088.295515] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4088.298394] Lustre: Skipped 1 previous similar message [ 4089.616261] Lustre: server umount lustre-OST0000 complete [ 4105.183099] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4105.241455] Lustre: server umount lustre-MDT0000 complete [ 4106.536417] LustreError: 277872:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945341 with bad export cookie 936696816068005249 [ 4106.540948] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4106.542833] LustreError: 277872:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4106.671547] Lustre: server umount lustre-MDT0001 complete [ 4110.527793] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 4111.651492] Key type lgssc unregistered [ 4111.790463] LNet: 281453:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4111.792751] LNetError: 281453:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4111.799449] LNet: Removed LNI 192.168.203.117@tcp [ 4112.125518] Key type .llcrypt unregistered [ 4112.126602] Key type ._llcrypt unregistered [ 4124.311801] Key type ._llcrypt registered [ 4124.313541] Key type .llcrypt registered [ 4124.355433] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 4130.779467] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4131.109407] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4131.159324] alg: No test for adler32 (adler32-zlib) [ 4132.006664] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 4132.091043] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 4133.671144] Key type lgssc registered [ 4134.046674] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4145.543197] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4145.547990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4146.631845] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4146.641802] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4146.677873] Lustre: lustre-MDT0000: new disk, initializing [ 4146.701566] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4146.709867] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4148.196095] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4152.455203] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4152.504263] Lustre: 285346:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4152.534734] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4152.536466] Lustre: Skipped 1 previous similar message [ 4152.571610] Lustre: lustre-MDT0001: new disk, initializing [ 4152.614651] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4152.628054] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4152.632919] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4153.914373] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4157.020853] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4158.223684] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4160.570955] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4160.676222] Lustre: lustre-OST0000: new disk, initializing [ 4160.677960] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4160.703628] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4162.362302] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4162.364711] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4162.401371] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4162.683507] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4165.757455] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4169.215047] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4171.702349] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4180.089178] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4223.969874] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4223.970779] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4223.974541] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4223.976911] LustreError: Skipped 1 previous similar message [ 4223.981913] Lustre: Skipped 1 previous similar message [ 4226.648743] Lustre: server umount lustre-OST0000 complete [ 4229.088629] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4229.089289] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4229.091912] Lustre: Skipped 2 previous similar messages [ 4229.094525] Lustre: Skipped 1 previous similar message [ 4234.208035] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4234.210679] Lustre: Skipped 1 previous similar message [ 4239.328199] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4239.330279] Lustre: Skipped 1 previous similar message [ 4242.399115] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4242.457285] Lustre: server umount lustre-MDT0000 complete [ 4243.651682] LustreError: 285338:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945478 with bad export cookie 13741167026401979906 [ 4243.654798] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4243.655022] LustreError: 285338:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4243.769110] Lustre: server umount lustre-MDT0001 complete [ 4246.544943] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4247.901510] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4249.486102] Lustre: server umount MGS complete [ 4253.167753] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4253.321130] LustreError: 290867:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4253.327548] LustreError: 290880:0:(qmt_pool.c:1614:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4253.328939] LustreError: 290867:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4253.351761] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4254.595128] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4257.401712] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4257.520904] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4258.818724] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4260.580936] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4261.805175] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4263.994690] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4265.890623] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4267.680087] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4304.352498] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4304.354816] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4304.356246] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4304.358350] Lustre: Skipped 1 previous similar message [ 4306.189648] Lustre: server umount lustre-OST0000 complete [ 4308.959954] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4308.963959] LustreError: Skipped 1 previous similar message [ 4308.966353] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4313.562876] Lustre: server umount lustre-MDT0000 complete [ 4314.592532] LustreError: 290868:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4314.599155] LustreError: 290868:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4314.891310] LustreError: 291583:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945549 with bad export cookie 13741167026401981719 [ 4314.894992] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4314.895937] LustreError: 291583:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4315.017425] Lustre: server umount lustre-MDT0001 complete [ 4318.545469] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 4319.511517] Key type lgssc unregistered [ 4319.622263] LNet: 294478:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4319.624329] LNetError: 294478:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4319.631293] LNet: Removed LNI 192.168.203.117@tcp [ 4319.910991] Key type .llcrypt unregistered [ 4319.912698] Key type ._llcrypt unregistered [ 4326.146567] Key type ._llcrypt registered [ 4326.147866] Key type .llcrypt registered [ 4326.186516] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 4331.684729] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4332.049440] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4332.080799] alg: No test for adler32 (adler32-zlib) [ 4332.920783] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 4333.004059] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 4334.583128] Key type lgssc registered [ 4334.904328] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4342.151743] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4346.801332] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4346.806704] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4347.898024] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4347.911266] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4347.949824] Lustre: lustre-MDT0000: new disk, initializing [ 4347.972288] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4347.980325] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4349.240905] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4353.195514] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4353.289413] Lustre: lustre-OST0000: new disk, initializing [ 4353.291816] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4353.293909] Lustre: Skipped 1 previous similar message [ 4353.315956] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4355.054845] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4356.282737] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4356.286853] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4356.293930] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4525.536622] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4525.543650] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4530.214206] Lustre: server umount lustre-MDT0000 complete [ 4531.518620] LustreError: 299291:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945766 with bad export cookie 4052096166509877448 [ 4531.520597] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4531.522174] LustreError: 299291:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4531.586939] Lustre: server umount lustre-OST0000 complete [ 4540.009689] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 4543.675528] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4556.225284] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4556.317990] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4556.330059] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4556.371173] Lustre: lustre-MDT0000: new disk, initializing [ 4556.402086] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4556.411875] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4557.745947] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4561.872021] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4561.912356] Lustre: 302605:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4561.935547] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4561.938947] Lustre: Skipped 1 previous similar message [ 4561.974701] Lustre: lustre-MDT0001: new disk, initializing [ 4562.006875] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4562.020685] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4562.024053] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4563.287653] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4566.498159] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4567.611705] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4570.242926] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4570.364502] Lustre: lustre-OST0000: new disk, initializing [ 4570.366809] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4570.395429] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4572.282841] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4575.445565] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4576.761342] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4576.764392] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4576.797514] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4576.858365] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4576.929498] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4578.241429] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4578.310045] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4581.857214] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4581.859305] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4581.863634] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4581.865088] Lustre: Skipped 1 previous similar message [ 4585.038388] Lustre: server umount lustre-OST0000 complete [ 4586.977032] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4586.977806] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4586.981634] Lustre: Skipped 2 previous similar messages [ 4592.096105] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4592.099727] Lustre: Skipped 2 previous similar messages [ 4592.344847] Lustre: server umount lustre-MDT0000 complete [ 4593.536657] LustreError: 302597:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945828 with bad export cookie 4052096166512818225 [ 4593.541021] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4593.542477] LustreError: 302597:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4593.665396] Lustre: server umount lustre-MDT0001 complete [ 4594.810892] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 4595.406330] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 14:43:49 (1773945829) [ 4597.587896] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4597.751258] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4599.019658] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4601.737181] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4603.147248] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4604.977425] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4606.221283] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4608.451659] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4610.468679] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4612.201323] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4614.510385] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4614.574701] Lustre: lustre-OST0001: new disk, initializing [ 4614.576549] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4614.603975] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4614.606029] Lustre: Skipped 2 previous similar messages [ 4614.732787] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4614.737795] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4614.752743] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4615.778634] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4615.781416] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 4616.439340] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4616.802214] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4616.807796] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4618.850808] LustreError: 309047:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4618.855735] LustreError: 309047:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 4620.087083] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4622.949352] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4622.952527] LustreError: 309041:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 6 previous similar messages [ 4623.219715] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 3 sec [ 4624.409262] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8b6606a70000.ost_server_uuid 50 [ 4624.949958] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8b6606a70000.ost_server_uuid in FULL state after 0 sec [ 4626.160713] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8b6606a70000.ost_server_uuid 50 [ 4626.690552] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8b6606a70000.ost_server_uuid in FULL state after 0 sec [ 4628.071939] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4638.692297] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4638.692330] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4638.697345] LustreError: Skipped 2 previous similar messages [ 4638.702733] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4638.707686] Lustre: Skipped 1 previous similar message [ 4644.346049] Lustre: server umount lustre-OST0001 complete [ 4644.426045] LustreError: 309048:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.17@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4644.431232] LustreError: 309048:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4647.392070] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4647.395590] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4647.401893] Lustre: Skipped 1 previous similar message [ 4647.404292] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4647.407012] Lustre: Skipped 3 previous similar messages [ 4648.932382] LustreError: 309455:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4648.937378] LustreError: 309455:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4651.919252] Lustre: server umount lustre-OST0000 complete [ 4659.356338] Lustre: server umount lustre-MDT0000 complete [ 4660.587184] LustreError: 306490:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773945895 with bad export cookie 4052096166512819107 [ 4660.590721] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4660.591050] LustreError: 306490:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4660.716271] Lustre: server umount lustre-MDT0001 complete [ 4664.175723] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 4665.207634] Key type lgssc unregistered [ 4665.338411] LNet: 311469:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4665.340623] LNetError: 311469:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4665.347402] LNet: Removed LNI 192.168.203.117@tcp [ 4665.671093] Key type .llcrypt unregistered [ 4665.672390] Key type ._llcrypt unregistered [ 4674.838614] Key type ._llcrypt registered [ 4674.839508] Key type .llcrypt registered [ 4674.880957] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4675.191574] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4675.224036] alg: No test for adler32 (adler32-zlib) [ 4676.069660] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 4676.156012] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 4677.735139] Key type lgssc registered [ 4678.095585] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4680.692883] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4680.698631] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4681.871931] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4683.193977] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4684.992343] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4687.313798] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4687.443847] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4688.671674] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4692.687985] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4692.832183] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4694.869495] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4696.744305] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4697.955605] LustreError: 314398:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4697.962979] LustreError: 314398:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4699.062951] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4699.133974] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4700.958941] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4702.720746] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 4707.316251] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 4707.321538] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 4709.611720] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 4709.727306] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4786.144285] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4786.149686] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4786.158471] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4789.219963] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4789.220980] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4789.233100] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4792.203531] Lustre: server umount lustre-OST0001 complete [ 4794.340919] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4794.345608] LustreError: 315843:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4794.349186] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4794.349413] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4794.349426] Lustre: Skipped 1 previous similar message [ 4794.353232] LustreError: 315843:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4799.459369] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4799.459684] LustreError: 314399:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4799.461114] Lustre: Skipped 1 previous similar message [ 4799.464916] LustreError: 314399:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4800.152161] Lustre: server umount lustre-OST0000 complete [ 4804.577387] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4804.582523] Lustre: Skipped 1 previous similar message [ 4804.585258] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4804.587827] Lustre: Skipped 1 previous similar message [ 4814.816064] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4814.817803] Lustre: Skipped 3 previous similar messages [ 4816.351090] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4816.415349] Lustre: server umount lustre-MDT0000 complete [ 4817.592109] LustreError: 312830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773946052 with bad export cookie 9515759699976128619 [ 4817.595441] LustreError: 312830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4817.596605] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4817.719101] Lustre: server umount lustre-MDT0001 complete [ 4821.410891] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 4822.447774] Key type lgssc unregistered [ 4822.585637] LNet: 317403:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4822.587993] LNetError: 317403:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4822.593391] LNet: Removed LNI 192.168.203.117@tcp [ 4822.935435] Key type .llcrypt unregistered [ 4822.936711] Key type ._llcrypt unregistered [ 4841.026041] Key type ._llcrypt registered [ 4841.027061] Key type .llcrypt registered [ 4841.060119] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4841.462607] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4841.492595] alg: No test for adler32 (adler32-zlib) [ 4842.362699] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 4842.449265] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 4844.031127] Key type lgssc registered [ 4844.451679] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4847.649226] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4847.654789] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4848.835642] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4850.141160] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4853.036363] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4853.202864] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4854.505607] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4855.508642] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4857.745665] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4857.881874] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4858.916365] LustreError: 321109:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4858.919766] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 4858.921626] LustreError: 321109:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4859.732903] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4862.519155] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4862.598471] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4863.665073] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 4864.473768] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4868.636197] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4874.368285] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 4883.936117] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4883.938099] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4883.941962] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4884.451738] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4884.451969] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4884.457757] Lustre: Skipped 1 previous similar message [ 4884.459861] Lustre: Skipped 1 previous similar message [ 4889.192330] Lustre: server umount lustre-MDT0000 complete [ 4889.569277] LustreError: 319649:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4889.577379] LustreError: 319649:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4890.483214] LustreError: 319635:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773946125 with bad export cookie 17857160753121142346 [ 4890.486547] LustreError: 319635:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4890.486718] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4890.598045] Lustre: server umount lustre-MDT0001 complete [ 4901.887201] Lustre: server umount lustre-OST0000 complete [ 4913.306275] Lustre: server umount lustre-OST0001 complete [ 4918.700465] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4922.895963] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4923.082430] LustreError: 324835:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4923.110370] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4924.698068] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4927.499562] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4928.902882] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4929.997482] Lustre: 325943:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4932.255913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4932.380597] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4932.383169] Lustre: Skipped 1 previous similar message [ 4933.410733] LustreError: 326295:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4933.414362] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 4934.189615] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4937.009368] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4938.162512] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 4939.024228] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 4942.305760] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4943.558711] Lustre: 327786:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4953.573308] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4953.574267] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4953.576654] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4953.576663] Lustre: Skipped 2 previous similar messages [ 4953.579801] Lustre: Skipped 4 previous similar messages [ 4955.680045] Lustre: server umount lustre-MDT0000 complete [ 4956.903174] LustreError: 327788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773946191 with bad export cookie 17857160753121144005 [ 4956.906965] LustreError: 327788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4956.907145] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4957.026216] Lustre: server umount lustre-MDT0001 complete [ 4968.897522] Lustre: server umount lustre-OST0000 complete [ 4979.420432] Lustre: server umount lustre-OST0001 complete [ 4980.624543] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 4981.174871] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 4981.754399] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 14:50:15 (1773946215) [ 4989.116279] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 4992.304567] loop0: detected capacity change from 0 to 1099511627776 [ 4992.460217] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 4992.462563] *** VALIDATE xfs *** [ 4992.470927] XFS (loop0): Mounting V5 Filesystem [ 4992.480422] XFS (loop0): Ending clean mount [ 4992.899119] loop1: detected capacity change from 0 to 18691697672192 [ 5012.536047] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 5015.390225] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 5027.366562] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5027.457238] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5027.469510] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5027.506070] Lustre: lustre-MDT0000: new disk, initializing [ 5027.529383] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5027.531397] Lustre: Skipped 1 previous similar message [ 5027.536895] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5028.850745] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5032.879024] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5032.918632] Lustre: 332848:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5032.942096] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5032.943679] Lustre: Skipped 1 previous similar message [ 5032.978656] Lustre: lustre-MDT0001: new disk, initializing [ 5033.021820] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5033.025074] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5034.258968] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5037.240426] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5038.392551] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5040.556325] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5040.653439] Lustre: lustre-OST0000: new disk, initializing [ 5040.656386] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5042.443652] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5042.489054] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5042.492832] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5042.533493] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5045.344602] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5046.613859] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5046.685627] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5048.002902] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 5048.078142] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5052.899661] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5052.902673] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5052.903619] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5052.906918] Lustre: Skipped 1 previous similar message [ 5052.908532] Lustre: Skipped 3 previous similar messages [ 5054.869055] Lustre: server umount lustre-OST0000 complete [ 5058.016909] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5058.017928] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5058.021352] Lustre: Skipped 1 previous similar message [ 5058.023175] Lustre: Skipped 1 previous similar message [ 5062.234956] Lustre: server umount lustre-MDT0000 complete [ 5063.135928] LustreError: 333978:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5063.139935] LustreError: 333978:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5063.456288] LustreError: 332840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773946298 with bad export cookie 17857160753121145559 [ 5063.459548] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5063.460312] LustreError: 332840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5063.575571] Lustre: server umount lustre-MDT0001 complete [ 5066.402868] XFS (loop0): Unmounting Filesystem [ 5067.957694] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 14:51:41 (1773946301) [ 5070.233161] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5070.408641] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5070.411229] Lustre: Skipped 2 previous similar messages [ 5071.663853] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5074.380095] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5075.865054] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5077.734639] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5078.977398] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5081.318405] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5083.303367] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5085.137724] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5105.120762] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5105.123039] LustreError: Skipped 1 previous similar message [ 5105.124216] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5105.127822] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5105.129330] Lustre: Skipped 1 previous similar message [ 5109.833936] Lustre: server umount lustre-OST0000 complete [ 5117.216419] Lustre: server umount lustre-MDT0000 complete [ 5118.439154] LustreError: 336980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773946353 with bad export cookie 17857160753121146441 [ 5118.442114] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5118.445288] LustreError: 336980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5118.558944] Lustre: server umount lustre-MDT0001 complete [ 5122.239791] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 5123.246952] Key type lgssc unregistered [ 5123.372362] LNet: 340291:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5123.374620] LNetError: 340291:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5123.380314] LNet: Removed LNI 192.168.203.117@tcp [ 5123.676104] Key type .llcrypt unregistered [ 5123.677240] Key type ._llcrypt unregistered [ 5133.700542] Key type ._llcrypt registered [ 5133.701934] Key type .llcrypt registered [ 5133.740865] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 5134.098415] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5134.161181] alg: No test for adler32 (adler32-zlib) [ 5135.010409] Lustre: Lustre: Build Version: 2.17.50_193_gf5bca74 [ 5135.096900] LNet: Added LNI 192.168.203.117@tcp [8/256/0/180] [ 5136.679132] Key type lgssc registered [ 5137.046855] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5139.541622] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5139.546787] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5140.690927] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5141.912726] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5144.652694] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5144.777468] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5146.047059] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5147.764596] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5148.911937] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5151.054893] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5151.173378] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5152.892784] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5154.593345] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5160.418129] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5160.418605] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5160.421832] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5160.424853] Lustre: Skipped 1 previous similar message [ 5161.039953] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.17@tcp (stopping) [ 5164.175295] Lustre: server umount lustre-MDT0001 complete [ 5165.537159] LustreError: 341818:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5165.541773] LustreError: 341818:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5166.153806] LustreError: 341812:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.17@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5167.444588] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5167.477529] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5167.479131] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5167.495640] Lustre: 341807:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5167.603603] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5168.863764] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5172.710220] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5173.732594] LustreError: 345180:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5173.735547] LustreError: 345180:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5173.738640] LustreError: 341809:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5173.753144] LustreError: 345183:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.203.117@tcp: cfg command failed: rc = -17 [ 5173.756595] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 5173.756595] [ 5473.360318] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.17@tcp (stopping) [ 5474.789365] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5474.789581] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5474.796346] Lustre: Skipped 2 previous similar messages [ 5477.777314] Lustre: server umount lustre-MDT0001 complete [ 5478.473657] LustreError: 341814:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.17@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5481.117152] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5481.151408] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5481.154166] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5481.171365] Lustre: 341804:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5481.276040] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5482.506033] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5486.564202] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5490.150833] LustreError: 358035:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5490.153209] LustreError: 358035:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5490.155764] LustreError: 341809:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5490.158865] LustreError: 341809:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5490.179254] LustreError: 358040:0:(obd_config.c:797:class_setup()) Device 8 already setup (type osp) [ 5490.181473] LustreError: 358040:0:(obd_config.c:902:class_detach()) OBD device 8 still set up [ 5490.183845] LustreError: 358040:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.203.117@tcp: cfg command failed: rc = -17 [ 5490.187150] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.117@tcp [ 5490.187150] [ 5785.679364] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.17@tcp (stopping) [ 5785.681429] Lustre: Skipped 2 previous similar messages [ 5786.593330] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5790.794094] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.17@tcp (stopping) [ 5790.796449] Lustre: Skipped 2 previous similar messages [ 5799.391100] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5799.444499] Lustre: server umount lustre-MDT0001 complete [ 5801.034904] LustreError: 341813:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.17@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5801.039829] LustreError: 341813:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5802.782155] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5802.815338] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5802.817880] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5802.832589] Lustre: 341806:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5802.943437] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 5804.203432] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 5808.103984] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5810.664568] LustreError: 370623:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5810.670227] LustreError: 370623:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5810.674472] LustreError: 341809:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5810.677653] LustreError: 341809:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5810.704547] LustreError: 370633:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 5810.713709] LustreError: 370633:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.203.117@tcp: cfg command failed: rc = -114 [ 5810.718637] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 5810.718637] [ 6120.421141] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6120.424971] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6120.427577] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6120.427601] Lustre: Skipped 5 previous similar messages [ 6120.431608] Lustre: Skipped 3 previous similar messages [ 6124.672709] Lustre: server umount lustre-MDT0000 complete [ 6125.539514] LustreError: 341812:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6125.543516] LustreError: 341812:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 6126.297196] LustreError: 344670:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773947360 with bad export cookie 17354522383110233814 [ 6126.304283] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6126.305516] LustreError: 344670:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6130.658075] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6132.510713] Lustre: server umount lustre-MDT0001 complete [ 6134.355769] Lustre: server umount lustre-OST0000 complete [ 6138.206553] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 6141.839638] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 6156.287845] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 15:09:49 (1773947389) [ 6159.324943] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6159.476787] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6159.495546] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6159.543995] Lustre: lustre-MDT0000: new disk, initializing [ 6159.570781] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6159.577415] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6160.788786] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 6165.850695] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6165.914590] Lustre: 384788:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6165.960442] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6165.963128] Lustre: Skipped 1 previous similar message [ 6166.006194] Lustre: lustre-MDT0001: new disk, initializing [ 6166.061475] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6166.081287] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6166.088090] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6167.654107] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 6171.434818] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6172.963371] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6175.656407] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6175.819233] Lustre: lustre-OST0000: new disk, initializing [ 6175.823657] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6175.876530] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6177.682808] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6177.690733] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6177.756750] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6178.461664] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug -1 all [ 6181.999142] Lustre: DEBUG MARKER: oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6186.463846] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6186.465878] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6186.469453] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6186.472038] Lustre: Skipped 4 previous similar messages [ 6190.945489] Lustre: server umount lustre-MDT0000 complete [ 6192.373716] LustreError: 385564:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773947427 with bad export cookie 17354522383110235760 [ 6192.377564] LustreError: 385576:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 6192.381998] LustreError: MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6192.546891] Lustre: server umount lustre-MDT0001 complete [ 6204.644601] Lustre: server umount lustre-OST0000 complete [ 6217.182892] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing set_hostid [ 6221.037817] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local [ 6235.481482] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 6111 sec ========== 15:11:08 (1773947468) [ 6236.266205] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 15:11:09 (1773947469) === [ 6237.614714] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 15:11:11 (1773947471) === [ 6255.142157] Lustre: DEBUG MARKER: oleg317-server.virtnet: executing unload_modules_local [ 6256.251095] Key type lgssc unregistered [ 6256.381384] LNet: 392719:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6256.383987] LNetError: 392719:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6256.399421] LNet: Removed LNI 192.168.203.117@tcp [ 6256.708236] Key type .llcrypt unregistered [ 6256.710128] Key type ._llcrypt unregistered