[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 598757078 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002325] x2apic enabled [ 0.003008] Switched APIC routing to physical x2apic. [ 0.004012] kvm-guest: setup PV IPIs [ 0.007545] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008023] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009019] pid_max: default: 32768 minimum: 301 [ 0.010144] LSM: Security Framework initializing [ 0.011057] Yama: becoming mindful. [ 0.012045] SELinux: Initializing. [ 0.013089] *** VALIDATE selinux *** [ 0.025056] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.030464] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.031279] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.032101] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.033099] *** VALIDATE tmpfs *** [ 0.035611] *** VALIDATE proc *** [ 0.036220] *** VALIDATE cgroup *** [ 0.037009] *** VALIDATE cgroup2 *** [ 0.039130] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.041058] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.042009] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.043028] Spectre V2 : User space: Vulnerable [ 0.044007] Speculative Store Bypass: Vulnerable [ 0.046826] debug: unmapping init [mem 0xffffffffac659000-0xffffffffac660fff] [ 0.048912] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.049756] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.050021] ... version: 2 [ 0.051011] ... bit width: 48 [ 0.052010] ... generic registers: 4 [ 0.053068] ... value mask: 0000ffffffffffff [ 0.054013] ... max period: 00007fffffffffff [ 0.055010] ... fixed-purpose events: 3 [ 0.056011] ... event mask: 000000070000000f [ 0.057345] rcu: Hierarchical SRCU implementation. [ 0.059354] smp: Bringing up secondary CPUs ... [ 0.060585] x86: Booting SMP configuration: [ 0.061024] .... node #0, CPUs: #1 #2 #3 [ 0.068194] smp: Brought up 1 node, 4 CPUs [ 0.070010] smpboot: Max logical packages: 1 [ 0.071011] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.140802] node 0 deferred pages initialised in 67ms [ 0.146290] devtmpfs: initialized [ 0.148204] x86/mm: Memory block size: 128MB [ 0.150335] gcov: version magic: 0x41383552 [ 0.152015] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.153058] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.154241] pinctrl core: initialized pinctrl subsystem [ 0.155133] [ 0.155435] ************************************************************* [ 0.156009] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.157011] ** ** [ 0.158007] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.159009] ** ** [ 0.160007] ** This means that this kernel is built to expose internal ** [ 0.161006] ** IOMMU data structures, which may compromise security on ** [ 0.162006] ** your system. ** [ 0.163006] ** ** [ 0.164005] ** If you see this message and you are not debugging the ** [ 0.165005] ** kernel, report this immediately to your vendor! ** [ 0.166005] ** ** [ 0.167005] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.168009] ************************************************************* [ 0.170152] NET: Registered protocol family 16 [ 0.171366] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.172041] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.173074] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.174314] cpuidle: using governor menu [ 0.175264] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.177374] PCI: Using configuration type 1 for base access [ 0.179122] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.189070] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.190015] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.193460] cryptd: max_cpu_qlen set to 1000 [ 0.195599] ACPI: Added _OSI(Module Device) [ 0.196007] ACPI: Added _OSI(Processor Device) [ 0.197006] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.198006] ACPI: Added _OSI(Processor Aggregator Device) [ 0.201524] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.203523] ACPI: Interpreter enabled [ 0.204062] ACPI: PM: (supports S0 S3 S4 S5) [ 0.205012] ACPI: Using IOAPIC for interrupt routing [ 0.206412] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.207595] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.218400] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.219037] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.220018] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.221080] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.223556] acpiphp: Slot [2] registered [ 0.224118] acpiphp: Slot [5] registered [ 0.225090] acpiphp: Slot [6] registered [ 0.226093] acpiphp: Slot [7] registered [ 0.227115] acpiphp: Slot [8] registered [ 0.228063] acpiphp: Slot [9] registered [ 0.229011] acpiphp: Slot [10] registered [ 0.230065] acpiphp: Slot [3] registered [ 0.231053] acpiphp: Slot [4] registered [ 0.232056] acpiphp: Slot [11] registered [ 0.233055] acpiphp: Slot [12] registered [ 0.233951] acpiphp: Slot [13] registered [ 0.235095] acpiphp: Slot [14] registered [ 0.236083] acpiphp: Slot [15] registered [ 0.238076] acpiphp: Slot [16] registered [ 0.239066] acpiphp: Slot [17] registered [ 0.240071] acpiphp: Slot [18] registered [ 0.241054] acpiphp: Slot [19] registered [ 0.242030] acpiphp: Slot [20] registered [ 0.243053] acpiphp: Slot [21] registered [ 0.243976] acpiphp: Slot [22] registered [ 0.245050] acpiphp: Slot [23] registered [ 0.245977] acpiphp: Slot [24] registered [ 0.248105] acpiphp: Slot [25] registered [ 0.249161] acpiphp: Slot [26] registered [ 0.251075] acpiphp: Slot [27] registered [ 0.252090] acpiphp: Slot [28] registered [ 0.254111] acpiphp: Slot [29] registered [ 0.255103] acpiphp: Slot [30] registered [ 0.257237] acpiphp: Slot [31] registered [ 0.259041] PCI host bridge to bus 0000:00 [ 0.260022] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.262023] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.265019] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.268026] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.271021] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.273023] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.276243] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.280056] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.283311] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.292812] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.299057] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.301026] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.303019] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.305027] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.309805] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.312827] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.315052] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.317920] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.323011] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.337016] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.342013] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.347973] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.355021] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.367016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.385018] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.395000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.430023] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.444026] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.461014] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.486000] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.492017] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.499018] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.565017] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.573108] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.583018] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.590015] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.605013] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.612139] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.618013] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.623014] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.637014] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.645022] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.650048] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.658016] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.676017] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.695638] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.699368] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.705405] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.711382] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.716253] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.724033] iommu: Default domain type: Passthrough [ 0.726478] SCSI subsystem initialized [ 0.728158] ACPI: bus type USB registered [ 0.729142] usbcore: registered new interface driver usbfs [ 0.730054] usbcore: registered new interface driver hub [ 0.731063] usbcore: registered new device driver usb [ 0.733326] pps_core: LinuxPPS API ver. 1 registered [ 0.734019] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.736061] PTP clock support registered [ 0.738068] EDAC MC: Ver: 3.0.0 [ 0.741177] PCI: Using ACPI for IRQ routing [ 0.746830] NetLabel: Initializing [ 0.749012] NetLabel: domain hash size = 128 [ 0.751009] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.752082] NetLabel: unlabeled traffic allowed by default [ 0.755067] vgaarb: loaded [ 0.756893] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.766046] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.781441] clocksource: Switched to clocksource kvm-clock [ 0.909453] VFS: Disk quotas dquot_6.6.0 [ 0.910861] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.913310] *** VALIDATE ramfs *** [ 0.914440] *** VALIDATE hugetlbfs *** [ 0.916202] pnp: PnP ACPI init [ 0.918941] pnp: PnP ACPI: found 6 devices [ 0.937238] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.940883] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.943262] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.945617] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.948360] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.951029] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.953913] NET: Registered protocol family 2 [ 0.956826] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.962864] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.966874] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.972458] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.977029] TCP: Hash tables configured (established 65536 bind 65536) [ 0.980302] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.983910] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.986746] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.988896] NET: Registered protocol family 1 [ 0.991352] RPC: Registered named UNIX socket transport module. [ 0.992707] RPC: Registered udp transport module. [ 0.993691] RPC: Registered tcp transport module. [ 0.994813] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.996230] NET: Registered protocol family 44 [ 0.997305] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.998587] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.999851] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.001295] PCI: CLS 0 bytes, default 64 [ 1.002592] Unpacking initramfs... [ 3.043388] debug: unmapping init [mem 0xffff9ecdfcc54000-0xffff9ecdfffbffff] [ 3.047664] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.050407] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 3.053822] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.593288] Initialise system trusted keyrings [ 3.594894] Key type blacklist registered [ 3.596867] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.606709] zbud: loaded [ 3.609666] *** VALIDATE nfs *** [ 3.610886] *** VALIDATE nfs4 *** [ 3.612668] pstore: using deflate compression [ 3.617906] Platform Keyring initialized [ 3.740340] NET: Registered protocol family 38 [ 3.742273] Key type asymmetric registered [ 3.743952] Asymmetric key parser 'x509' registered [ 3.746534] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.750380] io scheduler mq-deadline registered [ 3.752522] io scheduler kyber registered [ 3.754767] io scheduler bfq registered [ 3.757958] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.761229] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.764481] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.767746] ACPI: Power Button [PWRF] [ 3.773785] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.780847] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.792928] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.799261] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.860620] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.888086] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.944975] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.957784] Non-volatile memory driver v1.3 [ 3.960127] Linux agpgart interface v0.103 [ 3.996975] virtio_blk virtio1: [vda] 134864 512-byte logical blocks (69.1 MB/65.9 MiB) [ 4.000113] vda: detected capacity change from 0 to 69050368 [ 4.052934] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 4.055945] vdb: detected capacity change from 0 to 1073741824 [ 4.071523] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 4.074128] vdc: detected capacity change from 0 to 2621440000 [ 4.090868] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 4.093285] vdd: detected capacity change from 0 to 2621440000 [ 4.121674] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.124121] vde: detected capacity change from 0 to 4294967296 [ 4.145908] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.148551] vdf: detected capacity change from 0 to 4294967296 [ 4.155352] libphy: Fixed MDIO Bus: probed [ 4.170959] usbcore: registered new interface driver usbserial_generic [ 4.173037] usbserial: USB Serial support registered for generic [ 4.175897] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 4.181885] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 4.184324] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 4.187575] mousedev: PS/2 mouse device common for all mice [ 4.191350] rtc_cmos 00:05: RTC can wake from S4 [ 4.192122] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 4.196361] rtc_cmos 00:05: registered as rtc0 [ 4.202294] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 4.203943] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 4.204653] intel_pstate: CPU model not supported [ 4.212346] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 4.213919] hid: raw HID events driver (C) Jiri Kosina [ 4.217429] usbcore: registered new interface driver usbhid [ 4.218915] usbhid: USB HID core driver [ 4.220451] drop_monitor: Initializing network drop monitor service [ 4.223506] Initializing XFRM netlink socket [ 4.227202] NET: Registered protocol family 10 [ 4.232754] Segment Routing with IPv6 [ 4.234367] NET: Registered protocol family 17 [ 4.236822] mpls_gso: MPLS GSO support [ 4.242906] RAS: Correctable Errors collector initialized. [ 4.245159] AVX version of gcm_enc/dec engaged. [ 4.246839] AES CTR mode by8 optimization enabled [ 4.325978] sched_clock: Marking stable (4325898628, 0)->(5344868219, -1018969591) [ 4.329091] registered taskstats version 1 [ 4.330347] Loading compiled-in X.509 certificates [ 4.331508] zswap: loaded using pool lzo/zbud [ 4.350128] Key type big_key registered [ 4.359369] Key type encrypted registered [ 4.360533] ima: No TPM chip found, activating TPM-bypass! [ 4.362503] ima: Allocated hash algorithm: sha1 [ 4.363734] ima: No architecture policies found [ 4.364892] evm: Initialising EVM extended attributes: [ 4.366445] evm: security.selinux [ 4.367426] evm: security.ima [ 4.368231] evm: security.capability [ 4.368996] evm: HMAC attrs: 0x1 [ 4.370947] rtc_cmos 00:05: setting system clock to 2026-06-01 15:13:38 UTC (1780326818) [ 4.375707] debug: unmapping init [mem 0xffffffffad603000-0xffffffffad7fffff] [ 4.378346] debug: unmapping init [mem 0xffffffffac382000-0xffffffffac658fff] [ 4.386045] Write protecting the kernel read-only data: 28672k [ 4.388272] debug: unmapping init [mem 0xffffffffaaa03000-0xffffffffaabfffff] [ 4.390070] debug: unmapping init [mem 0xffffffffab314000-0xffffffffab3fffff] [ 4.414405] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.419220] systemd[1]: Detected virtualization kvm. [ 4.420270] systemd[1]: Detected architecture x86-64. [ 4.421278] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.449076] systemd[1]: No hostname configured. [ 4.451495] systemd[1]: Set hostname to . [ 4.454914] random: systemd: uninitialized urandom read (16 bytes read) [ 4.458254] systemd[1]: Initializing machine ID from random generator. [ 4.542503] random: ln: uninitialized urandom read (6 bytes read) [ 4.647440] random: systemd: uninitialized urandom read (16 bytes read) [ 4.651614] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.658484] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.664095] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Reached target Swap. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Memstrack Anylazing Service. Starting Setup Virtual Console... [ OK ] Listening on udev Kernel Socket. Starting Apply Kernel Variables... [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. Starting Journal Service... Starting Create Volatile Files and Directories... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Volatile Files and Directories. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 6.052788] device-mapper: uevent: version 1.0.3 [ 6.055372] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 7.293332] virtio_net virtio0 ens2: renamed from eth0 [ 7.387650] random: fast init done [ 7.448235] scsi host0: ata_piix [ 7.468816] scsi host1: ata_piix [ 7.474455] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 7.480605] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 12.977391] random: crng init done [ 12.981693] random: 7 urandom warning(s) missed due to ratelimiting [ 15.591915] dracut-initqueue[585]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 18.306853] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Swap. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Local File Systems. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 21.674835] printk: systemd: 26 output lines suppressed due to ratelimiting [ 22.258149] SELinux: Disabled at runtime. [ 22.326839] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 22.332552] systemd[1]: Detected virtualization kvm. [ 22.333924] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 23.047699] systemd[1]: initrd-switch-root.service: Succeeded. [ 23.090367] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 23.143795] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 23.168921] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 23.176772] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 23.216983] systemd[1]: Starting Journal Service... Starting Journal Service... [ 23.225232] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ OK ] Listening on RPCbind Server Activation Socket. Starting Remount Root and Kernel File Systems... Starting Apply Kernel Variables... [ OK ] Reached target RPC Port Mapper. [ OK ] Started Forward Password Requests to Wall Directory Watch. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-getty.slice. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ 23.518291] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Kernel Debug File System... [ OK ] Listening on udev Control Socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... Mounting Huge Pages File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Huge Pages File System. [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Configure read-only root support... Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ 25.190799] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /mnt. [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 27.072147] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 27.163454] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 27.619542] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 27.671408] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit)[ 32.274431] Key type dns_resolver registered [ *** ] A start job is running for Configur…-only root support (9s / no limit)[ 33.097787] NFS: Registering the id_resolver key type [ 33.103884] Key type id_resolver registered [ 33.105748] Key type id_legacy registered [ *** ] A start job is running for Configur…only root support (10s / no limit) [ ***] A start job is running for Configur…only root support (10s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. [ OK ] Started dnf makecache --timer. Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Daily Cleanup of Temporary Directories. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started Login Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg234-server login: [ 80.998090] libcfs: loading out-of-tree module taints kernel. [ 81.023844] Key type ._llcrypt registered [ 81.025448] Key type .llcrypt registered [ 81.102100] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 95.654743] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 96.941514] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 96.950151] alg: No test for adler32 (adler32-zlib) [ 98.433461] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 99.179823] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 100.928183] Key type lgssc registered [ 102.388239] Lustre: Echo OBD driver; http://www.lustre.org/ [ 116.484631] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 147.099382] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 157.467688] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 157.506592] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 158.739209] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 158.760398] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 158.833308] Lustre: lustre-MDT0000: new disk, initializing [ 158.934569] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 158.946673] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 162.375717] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 170.741005] hrtimer: interrupt took 9787682 ns [ 173.713197] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 173.811432] Lustre: 6495:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 173.844528] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 173.847235] Lustre: Skipped 1 previous similar message [ 173.918800] Lustre: lustre-MDT0001: new disk, initializing [ 173.976364] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 174.006601] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 174.018374] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 177.502687] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 181.435802] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 189.033543] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 189.241364] Lustre: lustre-OST0000: new disk, initializing [ 189.243641] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 189.247693] Lustre: 8403:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 189.287809] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 189.971896] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 189.977864] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 190.062135] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 193.626222] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 205.890886] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 205.985986] Lustre: lustre-OST0001: new disk, initializing [ 205.990048] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 205.996526] Lustre: 9457:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 206.044995] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 210.439978] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 213.525451] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 213.537918] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 213.575312] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 220.819313] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 226.885446] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 231.638926] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing check_logdir /tmp/testlogs/ [ 235.280692] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing yml_node [ 239.071390] Lustre: DEBUG MARKER: Client: 2.17.53.33 [ 241.081559] Lustre: DEBUG MARKER: MDS: 2.17.53.33 [ 243.054465] Lustre: DEBUG MARKER: OSS: 2.17.53.33 [ 244.499182] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Mon Jun 1 11:17:38 EDT 2026 [ 258.431308] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 259.775398] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 274.915093] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 274.918646] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 274.934421] Lustre: Skipped 3 previous similar messages [ 274.947798] Lustre: Skipped 3 previous similar messages [ 280.036736] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 280.042724] Lustre: Skipped 3 previous similar messages [ 280.483521] Lustre: server umount lustre-MDT0000 complete [ 283.390652] LustreError: 6489:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327097 with bad export cookie 14961195254787968217 [ 283.393715] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 283.402289] LustreError: 6489:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 285.159229] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 285.168846] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 285.172714] Lustre: Skipped 1 previous similar message [ 288.161372] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 288.170752] Lustre: Skipped 1 previous similar message [ 289.717495] Lustre: server umount lustre-MDT0001 complete [ 293.408208] Lustre: server umount lustre-OST0000 complete [ 296.697597] Lustre: server umount lustre-OST0001 complete [ 302.073202] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 309.149656] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 336.783157] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 337.046635] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 337.082779] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 337.156597] Lustre: lustre-MDT0000: new disk, initializing [ 337.267493] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 337.283486] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 340.510154] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 349.353595] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 349.462728] Lustre: 14963:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 349.538376] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 349.540677] Lustre: Skipped 1 previous similar message [ 349.632664] Lustre: lustre-MDT0001: new disk, initializing [ 349.729015] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 349.765347] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 349.784099] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 353.568496] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 359.874727] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 363.458103] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 368.826336] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 369.031172] Lustre: lustre-OST0000: new disk, initializing [ 369.034365] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 369.042651] Lustre: 16705:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 369.098436] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 370.466722] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 370.483296] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 370.596965] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 374.215776] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 380.282592] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 384.137431] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 384.320935] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 388.271219] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 388.474852] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 391.137446] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 391.141371] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 391.154467] LustreError: Skipped 1 previous similar message [ 391.155724] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 391.184987] Lustre: Skipped 2 previous similar messages [ 396.457233] Lustre: server umount lustre-OST0000 complete [ 400.866629] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 400.873119] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 400.882898] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 400.888230] Lustre: Skipped 3 previous similar messages [ 405.741538] Lustre: server umount lustre-MDT0000 complete [ 406.501283] LustreError: 14975:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 406.517765] LustreError: 14975:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 408.771619] LustreError: 14956:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327222 with bad export cookie 14961195254787969792 [ 408.778261] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 409.082284] Lustre: server umount lustre-MDT0001 complete [ 413.484540] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 11:20:27 (1780327227) [ 419.357385] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 419.763142] LustreError: 18822:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 419.829342] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 424.122112] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 424.933291] LustreError: 18823:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 429.038697] LustreError: 18822:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 431.870718] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 436.209105] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 440.911148] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 444.335263] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 450.216753] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 456.283780] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 461.228236] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 469.430706] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 478.180521] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 478.190520] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 478.203995] Lustre: Skipped 1 previous similar message [ 478.208382] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 478.217972] Lustre: Skipped 2 previous similar messages [ 481.546448] Lustre: server umount lustre-MDT0000 complete [ 484.323316] LustreError: 18822:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 484.333853] LustreError: 18822:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 484.565284] LustreError: 18803:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327298 with bad export cookie 14961195254787970716 [ 484.575845] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 484.581365] LustreError: 18803:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 484.835971] Lustre: server umount lustre-MDT0001 complete [ 498.289167] Lustre: server umount lustre-OST0000 complete [ 514.680082] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 522.095745] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 522.478704] LustreError: 22849:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 522.547443] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 522.550232] Lustre: Skipped 2 previous similar messages [ 526.070675] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 532.478177] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 536.020794] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 538.864336] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 544.268456] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 549.638954] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 556.515316] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 556.686170] Lustre: lustre-OST0001: new disk, initializing [ 556.688641] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 556.694114] Lustre: 25117:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 558.608515] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 558.615064] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 558.707822] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 561.823586] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 569.860528] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 572.595808] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 584.165200] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 584.167647] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 584.172018] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 584.180068] Lustre: Skipped 5 previous similar messages [ 584.187554] Lustre: Skipped 6 previous similar messages [ 588.853604] Lustre: server umount lustre-MDT0000 complete [ 589.287929] LustreError: 22850:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 589.295341] LustreError: 22850:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 591.670276] LustreError: 22831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327405 with bad export cookie 14961195254787971563 [ 591.675177] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 591.689403] LustreError: 22831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 591.959875] Lustre: server umount lustre-MDT0001 complete [ 604.063613] Lustre: server umount lustre-OST0000 complete [ 617.788981] Lustre: server umount lustre-OST0001 complete [ 629.746542] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 637.112981] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 637.469065] LustreError: 28102:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 640.762737] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 647.160126] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 650.617367] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 652.883481] Lustre: 29217:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 657.823720] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 658.152916] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 658.158864] Lustre: Skipped 5 previous similar messages [ 661.965743] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 667.705904] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 671.501275] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 676.824983] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 679.322668] Lustre: 31059:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 683.494749] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 683.497446] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 683.501445] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 683.515461] Lustre: Skipped 3 previous similar messages [ 688.760928] Lustre: server umount lustre-MDT0000 complete [ 691.048433] LustreError: 28083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327505 with bad export cookie 14961195254787972858 [ 691.056132] LustreError: 28083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 691.056267] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 691.236683] Lustre: server umount lustre-MDT0001 complete [ 702.942316] Lustre: server umount lustre-OST0000 complete [ 715.734092] Lustre: server umount lustre-OST0001 complete [ 721.221105] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 11:25:35 (1780327535) [ 739.529700] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 745.981407] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 746.232291] LustreError: 33839:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 746.251550] LustreError: 33839:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 748.990541] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 754.120182] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 756.814380] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 758.599111] Lustre: 34954:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 762.449652] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 766.774244] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 772.352773] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 776.656930] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 781.963614] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 784.170088] Lustre: 36797:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 787.938543] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 787.946734] Lustre: Skipped 2 previous similar messages [ 793.513908] Lustre: server umount lustre-MDT0000 complete [ 795.809683] LustreError: 33821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327609 with bad export cookie 14961195254787973964 [ 795.813811] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 795.823339] LustreError: 33821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 796.026642] Lustre: server umount lustre-MDT0001 complete [ 808.942875] Lustre: server umount lustre-OST0000 complete [ 821.633445] Lustre: server umount lustre-OST0001 complete [ 826.684658] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 11:27:20 (1780327640) [ 835.533145] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 841.182586] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 843.780071] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 848.650825] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 850.808744] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 852.250787] Lustre: 40034:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 855.564463] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 858.537474] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 863.284940] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 866.601957] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 871.779356] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 874.234983] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 874.237706] Lustre: Skipped 1 previous similar message [ 877.036739] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 877.038491] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 877.046945] Lustre: Skipped 4 previous similar messages [ 877.050424] Lustre: Skipped 18 previous similar messages [ 882.131729] Lustre: server umount lustre-MDT0000 complete [ 882.152102] LustreError: 38919:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 882.164224] LustreError: 38919:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 11 previous similar messages [ 884.640477] LustreError: 39652:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327698 with bad export cookie 14961195254787975063 [ 884.646175] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 884.649751] LustreError: 39652:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 890.907814] Lustre: server umount lustre-MDT0001 complete [ 895.175799] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 909.795336] LustreError: 3649:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9ece72017480 x1866808073484288/t0(0) o250->MGC192.168.202.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 912.378976] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 917.066517] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 917.330405] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 917.335206] Lustre: Skipped 10 previous similar messages [ 919.112491] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 919.400079] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 921.740401] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 924.764330] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 2 sec [ 926.953720] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 930.055362] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 2 sec [ 932.834435] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 938.431198] Lustre: server umount lustre-MDT0000 complete [ 940.688244] LustreError: 39652:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327754 with bad export cookie 14961195254787976197 [ 940.690977] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 940.695985] LustreError: 39652:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 940.898644] Lustre: server umount lustre-MDT0001 complete [ 953.375747] Lustre: server umount lustre-OST0000 complete [ 965.693374] Lustre: server umount lustre-OST0001 complete [ 970.331579] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 11:29:44 (1780327784) [ 979.216221] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 985.275668] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 988.251547] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 993.310875] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 995.809690] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 997.358304] Lustre: 47360:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 997.362756] Lustre: 47360:0:(mgs_llog.c:1437:mgs_modify_param()) Skipped 1 previous similar message [ 1000.610947] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1003.618505] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1008.301487] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1011.354973] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1016.676229] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1020.734432] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1036.259544] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1036.470687] Lustre: Skipped 9 previous similar messages [ 1042.119524] Lustre: server umount lustre-MDT0000 complete [ 1049.439811] LustreError: 47363:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780327863 with bad export cookie 14961195254787976988 [ 1049.442725] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1049.448385] LustreError: 47363:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1050.059270] Lustre: server umount lustre-MDT0001 complete [ 1066.829037] Lustre: server umount lustre-OST0000 complete [ 1067.257977] Lustre: 3650:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780327865/real 1780327865] req@ffff9ecd423d4a80 x1866808073564928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780327881 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1070.049957] Lustre: 3653:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780327868/real 1780327868] req@ffff9ecd44eaf800 x1866808073565184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780327884 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1072.453459] Lustre: server umount lustre-OST0001 complete [ 1084.298662] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 11:31:37 (1780327897) [ 1087.207206] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1089.306464] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 11:31:42 (1780327902) [ 1101.848832] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 1109.732952] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 1134.534848] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1134.887847] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1134.992500] Lustre: lustre-MDT0000: new disk, initializing [ 1135.112254] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1140.137454] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1147.710826] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1154.966096] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1155.371681] Lustre: 53260:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1157.465102] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1157.482139] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1161.530075] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1169.268730] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1171.415602] Lustre: DEBUG MARKER: create test files [ 1203.681593] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1203.694456] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1203.698649] Lustre: Skipped 19 previous similar messages [ 1208.578939] Lustre: server umount lustre-OST0000 complete [ 1213.172840] Lustre: server umount lustre-MDT0000 complete [ 1223.259712] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 1226.227143] Key type lgssc unregistered [ 1226.537866] LNet: 54760:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1226.543466] LNetError: 54760:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1226.558212] LNet: Removed LNI 192.168.202.134@tcp [ 1227.385174] Key type .llcrypt unregistered [ 1227.387586] Key type ._llcrypt unregistered [ 1256.628218] Key type ._llcrypt registered [ 1256.630426] Key type .llcrypt registered [ 1256.717630] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 1257.896343] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1257.928195] alg: No test for adler32 (adler32-zlib) [ 1259.000886] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 1259.288185] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 1260.984807] Key type lgssc registered [ 1262.437843] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1269.988797] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1270.036561] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1271.560687] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1276.033680] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1282.019981] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1289.783025] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1290.375758] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1296.499220] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1296.522445] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1296.570271] Lustre: 57363:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1296.580053] Lustre: 57363:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1296.590312] Lustre: 57363:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1296.608570] Lustre: 57363:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1296.618426] Lustre: 57363:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1296.629338] Lustre: 57363:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1301.590128] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1306.210534] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1311.919393] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1317.349393] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1317.349986] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1317.362219] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1319.531795] Lustre: server umount lustre-OST0000 complete [ 1323.161904] Lustre: server umount lustre-MDT0000 complete [ 1335.237840] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 1337.322704] Key type lgssc unregistered [ 1337.572873] LNet: 58840:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1337.579712] LNetError: 58840:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1337.593920] LNet: Removed LNI 192.168.202.134@tcp [ 1338.141761] Key type .llcrypt unregistered [ 1338.144558] Key type ._llcrypt unregistered [ 1369.848204] Key type ._llcrypt registered [ 1369.852110] Key type .llcrypt registered [ 1369.990678] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 1371.550183] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1371.576395] alg: No test for adler32 (adler32-zlib) [ 1372.591862] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 1372.714553] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 1374.352226] Key type lgssc registered [ 1375.656361] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1383.668228] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1383.726702] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1385.500259] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1391.306789] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1401.169269] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1412.653906] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1413.092673] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1422.134523] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1429.051424] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1430.472797] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1430.558794] Lustre: 61551:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1430.567511] Lustre: 61551:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1430.574040] Lustre: 61551:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1430.580949] Lustre: 61551:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1430.600026] Lustre: 61551:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1430.609042] Lustre: 61551:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1436.332541] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1476.580983] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1476.608980] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1476.615519] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1481.698732] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1482.704529] Lustre: server umount lustre-OST0000 complete [ 1487.428576] Lustre: server umount lustre-MDT0000 complete [ 1501.752091] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 1505.524484] Key type lgssc unregistered [ 1505.737944] LNet: 63006:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1505.743872] LNetError: 63006:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1505.766959] LNet: Removed LNI 192.168.202.134@tcp [ 1506.590080] Key type .llcrypt unregistered [ 1506.593754] Key type ._llcrypt unregistered [ 1525.833720] Key type ._llcrypt registered [ 1525.840710] Key type .llcrypt registered [ 1525.997739] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 1543.098244] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 1544.134805] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1544.162632] alg: No test for adler32 (adler32-zlib) [ 1545.088816] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 1545.185074] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 1546.832206] Key type lgssc registered [ 1548.132276] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1585.926167] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1585.959506] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1587.218223] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1587.251627] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1587.320261] Lustre: lustre-MDT0000: new disk, initializing [ 1587.397330] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1587.419699] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1591.559403] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1601.874251] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1602.024206] Lustre: 66124:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1602.099208] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1602.104666] Lustre: Skipped 1 previous similar message [ 1602.181985] Lustre: lustre-MDT0001: new disk, initializing [ 1602.338579] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1602.395225] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1602.409570] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1607.297366] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1614.299918] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1618.702068] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1626.483104] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1626.837650] Lustre: lustre-OST0000: new disk, initializing [ 1626.842461] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1626.852114] Lustre: 67871:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1626.977911] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1633.272976] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1635.394277] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1635.417075] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1635.573031] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1641.462654] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1647.031807] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1647.238653] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1652.167653] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1652.427627] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1656.290959] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1656.295554] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1656.313557] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1656.343518] Lustre: Skipped 1 previous similar message [ 1661.004363] Lustre: server umount lustre-OST0000 complete [ 1666.541635] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1666.574965] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1666.577357] Lustre: Skipped 2 previous similar messages [ 1666.597259] Lustre: Skipped 1 previous similar message [ 1671.635388] Lustre: server umount lustre-MDT0000 complete [ 1676.498368] LustreError: 67870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780328490 with bad export cookie 8745265526257108105 [ 1676.504540] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1676.507233] LustreError: 67870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1676.920774] Lustre: server umount lustre-MDT0001 complete [ 1687.593547] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 11:41:40 (1780328500) [ 1702.390590] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 1745.931001] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 1756.806968] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 1796.542749] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1796.775438] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1796.809090] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1796.920862] Lustre: lustre-MDT0000: new disk, initializing [ 1797.030164] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1797.047754] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1801.343158] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1812.960906] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1813.131881] Lustre: 73709:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1813.206925] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1813.211853] Lustre: Skipped 1 previous similar message [ 1813.304408] Lustre: lustre-MDT0001: new disk, initializing [ 1813.397669] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1813.445257] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1813.463625] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1818.099964] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1826.331441] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1830.618451] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1836.904321] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1837.109878] Lustre: lustre-OST0000: new disk, initializing [ 1837.114452] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1837.119498] Lustre: 75452:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1837.206865] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1843.004824] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1845.848499] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1845.870306] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1845.978807] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1849.843788] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1853.940775] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1854.118217] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1858.537376] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1858.776140] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1861.611086] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1861.617800] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1861.624423] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1861.632769] Lustre: Skipped 1 previous similar message [ 1861.645479] Lustre: Skipped 1 previous similar message [ 1866.730082] LustreError: 75435:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1866.753916] LustreError: 75435:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1867.024568] Lustre: server umount lustre-OST0000 complete [ 1871.844567] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1871.859227] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1871.873023] Lustre: Skipped 1 previous similar message [ 1876.759118] Lustre: server umount lustre-MDT0000 complete [ 1876.962236] LustreError: 74792:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1876.987101] LustreError: 74792:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1879.542245] LustreError: 73702:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780328693 with bad export cookie 8745265526257109029 [ 1879.550829] LustreError: 73702:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1879.556454] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1879.926401] Lustre: server umount lustre-MDT0001 complete [ 1886.565182] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 11:45:00 (1780328700) [ 1892.249227] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1892.806244] LustreError: 77718:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1892.854302] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1896.682724] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1897.964450] LustreError: 77719:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1902.057842] LustreError: 77718:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1903.639625] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1907.949743] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1912.870989] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1916.179661] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1922.316764] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1928.790363] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1935.497061] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1939.635605] Lustre: 80050:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting bdb1553b-bcf9-46da-8749-bcd7f2ed7507 at adminstrative request [ 1942.503694] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1942.534917] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1952.743434] Lustre: MGS: Client bdb1553b-bcf9-46da-8749-bcd7f2ed7507 (at 0@lo) reconnecting [ 1952.757118] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x795d6ca967064bba to 0x795d6ca967064e61 [ 1952.800361] Lustre: MGC192.168.202.134@tcp: Connection restored to 0@lo (at 0@lo) [ 1976.914613] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1977.121583] Lustre: lustre-OST0001: new disk, initializing [ 1977.124987] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1977.130725] Lustre: 80442:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1977.235986] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1977.248984] Lustre: Skipped 2 previous similar messages [ 1983.330736] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 1985.676046] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1985.695268] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1985.820743] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1990.857508] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1996.265562] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1996.268945] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1996.276429] LustreError: Skipped 2 previous similar messages [ 1996.280449] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1996.296817] Lustre: Skipped 2 previous similar messages [ 1999.668191] Lustre: server umount lustre-OST0001 complete [ 2001.381050] LustreError: 79316:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2001.392956] LustreError: 79316:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2003.937488] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2005.985424] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2006.016948] Lustre: Skipped 1 previous similar message [ 2006.033898] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2006.044855] Lustre: Skipped 2 previous similar messages [ 2009.440183] Lustre: server umount lustre-OST0000 complete [ 2016.739893] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2016.748889] LustreError: Skipped 1 previous similar message [ 2019.069739] Lustre: server umount lustre-MDT0000 complete [ 2021.857334] LustreError: 79326:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2021.883950] LustreError: 79326:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2022.181600] LustreError: 77699:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780328836 with bad export cookie 8745265526257110625 [ 2022.183394] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2022.192366] LustreError: 77699:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2022.532756] Lustre: server umount lustre-MDT0001 complete [ 2029.260146] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 11:47:23 (1780328843) [ 2030.521337] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2032.128572] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 11:47:25 (1780328845) [ 2033.515897] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2034.989502] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 11:47:28 (1780328848) [ 2036.367512] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2037.958158] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 11:47:31 (1780328851) [ 2039.358671] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2040.718477] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 11:47:34 (1780328854) [ 2042.028841] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2047.680873] loop: module loaded [ 2047.699527] loop0: detected capacity change from 0 to 4294967296 [ 2047.758342] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2049.075349] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2051.937529] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2055.005310] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2077.181681] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2077.224575] LustreError: 84435:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2077.237553] LustreError: 84435:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2077.253166] LustreError: 84435:0:(tgt_mount.c:2537:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2077.264974] LustreError: 84435:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2092.047809] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 2101.107611] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 2133.637387] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2133.881981] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2133.908198] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2133.979980] Lustre: lustre-MDT0000: new disk, initializing [ 2134.057750] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2134.069973] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2137.789722] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2146.998994] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2147.148330] Lustre: 87265:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2147.417965] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2151.743280] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2158.450823] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2161.285773] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2167.282518] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2167.447992] Lustre: 89008:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2172.311884] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2172.969021] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2173.098832] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2178.450574] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2181.968400] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2182.120919] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2186.486314] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2186.644190] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2188.257859] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2188.265961] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2188.276203] Lustre: Skipped 2 previous similar messages [ 2188.278316] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2188.280312] Lustre: Skipped 4 previous similar messages [ 2194.249710] Lustre: server umount lustre-OST0000 complete [ 2203.691312] Lustre: server umount lustre-MDT0000 complete [ 2204.135100] LustreError: 87270:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2204.149956] LustreError: 87270:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2206.320448] LustreError: 87256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780329020 with bad export cookie 8745265526257111241 [ 2206.326873] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2206.329064] LustreError: 87256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2206.558667] Lustre: server umount lustre-MDT0001 complete [ 2212.390720] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 11:50:26 (1780329026) [ 2216.369563] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2219.143705] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2224.273297] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2227.080981] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2231.011618] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2233.101873] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2237.371663] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2240.735784] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2243.403727] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2245.431934] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2245.569924] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2247.850485] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2250.055404] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 2 sec [ 2253.357266] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2253.435979] Lustre: lustre-OST0001: new disk, initializing [ 2253.438241] Lustre: Skipped 2 previous similar messages [ 2253.440695] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2253.443301] Lustre: Skipped 3 previous similar messages [ 2253.445879] Lustre: 94279:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2256.428882] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2260.824801] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2262.051706] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2262.059038] Lustre: Skipped 2 previous similar messages [ 2262.062434] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2262.119678] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2263.207035] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2263.308403] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2265.598350] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2265.724532] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2279.278598] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2293.798085] Lustre: Failing over lustre-MDT0000 [ 2294.147101] Lustre: server umount lustre-MDT0000 complete [ 2296.289975] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2296.294066] LustreError: Skipped 2 previous similar messages [ 2296.296573] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2296.302822] Lustre: Skipped 3 previous similar messages [ 2296.305535] LustreError: 91289:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2296.315947] LustreError: 91289:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2312.314580] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2312.316618] LDISKFS-fs (dm-0): recovery complete [ 2312.324523] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2312.386554] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2312.543785] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2312.548354] Lustre: Skipped 6 previous similar messages [ 2312.594940] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2313.371707] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2313.373020] Lustre: 91267:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2314.982881] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2317.803655] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 2317.804329] Lustre: 91270:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2317.818856] Lustre: 91270:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 1 previous similar message [ 2317.866307] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2318.184238] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2318.507944] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2318.515857] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 1 previous similar message [ 2318.833070] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2318.844605] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 1 previous similar message [ 2318.853385] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2318.862479] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 7 previous similar messages [ 2319.810547] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2319.814954] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 3 previous similar messages [ 2320.128117] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2320.130843] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 3 previous similar messages [ 2321.075821] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2321.084514] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 6 previous similar messages [ 2322.028371] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2322.036147] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 6 previous similar messages [ 2322.352119] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2322.355328] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 6 previous similar messages [ 2325.176928] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2325.189281] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 12 previous similar messages [ 2326.141519] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2326.152487] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 12 previous similar messages [ 2326.480320] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2326.492739] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 12 previous similar messages [ 2333.401322] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2333.404882] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 25 previous similar messages [ 2334.354708] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2334.358677] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 25 previous similar messages [ 2334.672685] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2334.676716] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 25 previous similar messages [ 2349.434630] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2349.443395] Lustre: 96973:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 50 previous similar messages [ 2350.395590] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2350.403392] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 50 previous similar messages [ 2350.720098] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2350.723877] LustreError: 96973:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 50 previous similar messages [ 2373.080087] Lustre: 96973:0:(ldlm_lib.c:2378:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2373.088308] Lustre: 96973:0:(ldlm_lib.c:2388:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2373.097259] Lustre: 96973:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 848d86ec-13a7-475a-b7de-09a45b28130a@192.168.202.34@tcp [ 2373.106393] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2373.111189] Lustre: 96973:0:(ldlm_lib.c:1898:abort_req_replay_queue()) @@@ aborted: req@0000000059ca2ac7 x1866809572657152/t0(8589934776) o35->848d86ec-13a7-475a-b7de-09a45b28130a@192.168.202.34@tcp:692/0 lens 392/0 e 0 to 0 dl 1780329197 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2373.127960] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2373.138401] Lustre: lustre-MDT0000: Denying connection for new client 848d86ec-13a7-475a-b7de-09a45b28130a (at 192.168.202.34@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2373.148301] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2373.193773] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2373.196346] Lustre: Skipped 2 previous similar messages [ 2373.204285] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2373.240070] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 2373.243758] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 2388.454829] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2388.461823] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2388.469805] Lustre: Skipped 3 previous similar messages [ 2388.479615] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2388.485560] Lustre: Skipped 6 previous similar messages [ 2391.833659] Lustre: server umount lustre-OST0000 complete [ 2400.136484] Lustre: server umount lustre-OST0001 complete [ 2408.617527] Lustre: server umount lustre-MDT0000 complete [ 2410.745039] LustreError: 91251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780329224 with bad export cookie 8745265526257162495 [ 2410.746989] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2410.750961] LustreError: 91251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2411.032477] Lustre: server umount lustre-MDT0001 complete [ 2415.720855] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 11:53:49 (1780329229) [ 2420.555220] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2420.559362] Lustre: *** cfs_fail_loc=197, val=0*** [ 2436.129285] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2441.248572] LustreError: 98929:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.134@tcp: failed processing log, type 4: rc = -110 [ 2446.385340] Lustre: *** cfs_fail_loc=197, val=0*** [ 2446.387541] Lustre: Skipped 65 previous similar messages [ 2470.152819] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2472.973789] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2474.281205] Lustre: server umount lustre-OST0000 complete [ 2479.260771] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 11:54:53 (1780329293) [ 2495.564676] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2495.813072] LustreError: 100433:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2495.826630] LustreError: 100433:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 24 previous similar messages [ 2498.515214] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2503.552394] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2506.411204] LustreError: 100464:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2506.417509] LustreError: 100464:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2506.422475] LustreError: 100464:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -5 [ 2506.661845] Lustre: server umount lustre-MDT0000 complete [ 2525.435627] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 2530.097470] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 2546.904175] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2547.026526] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2547.052307] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2547.116136] Lustre: lustre-MDT0000: new disk, initializing [ 2547.204590] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2549.005817] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2554.003863] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2554.050715] Lustre: 104483:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2554.157376] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2555.625616] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2558.928278] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2560.288430] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2562.870269] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2562.988605] Lustre: 106226:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2565.336930] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2568.944556] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2569.262927] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2570.763365] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2570.868862] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2572.538702] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2572.624507] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2574.308463] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2574.310393] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2574.313154] LustreError: Skipped 4 previous similar messages [ 2574.313582] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2574.318282] Lustre: Skipped 6 previous similar messages [ 2574.320092] Lustre: Skipped 10 previous similar messages [ 2575.672955] Lustre: server umount lustre-OST0000 complete [ 2583.615476] Lustre: server umount lustre-MDT0000 complete [ 2585.422765] LustreError: 104476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780329399 with bad export cookie 8745265526257173114 [ 2585.423343] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2585.427531] LustreError: 104476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2585.570340] Lustre: server umount lustre-MDT0001 complete [ 2589.691435] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 11:56:43 (1780329403) [ 2593.418415] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 2594.801401] Key type lgssc unregistered [ 2595.001924] LNet: 108546:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2595.010240] LNetError: 108546:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2595.024929] LNet: Removed LNI 192.168.202.134@tcp [ 2595.469625] Key type .llcrypt unregistered [ 2595.470980] Key type ._llcrypt unregistered [ 2606.097297] Key type ._llcrypt registered [ 2606.098653] Key type .llcrypt registered [ 2606.146841] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 2615.245491] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 2615.730125] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2615.760359] alg: No test for adler32 (adler32-zlib) [ 2616.682383] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 2616.815741] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 2618.416153] Key type lgssc registered [ 2619.017625] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2638.892205] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2638.910745] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2640.054556] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2640.072657] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2640.126941] Lustre: lustre-MDT0000: new disk, initializing [ 2640.180117] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2640.189208] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2641.952939] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2647.940433] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2648.085493] Lustre: lustre-OST0000: new disk, initializing [ 2648.087497] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2648.090463] Lustre: Skipped 1 previous similar message [ 2648.092687] Lustre: 112644:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2648.121874] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2651.379407] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2655.815117] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2655.820178] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2655.845677] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2657.766903] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2657.853743] Lustre: lustre-OST0001: new disk, initializing [ 2657.856579] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2657.860404] Lustre: 113493:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2657.934606] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2661.013222] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2661.915685] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2661.920019] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2661.937797] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2666.977780] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2666.978712] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2666.985936] Lustre: Skipped 1 previous similar message [ 2672.098519] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2672.101449] Lustre: Skipped 2 previous similar messages [ 2672.265357] Lustre: server umount lustre-MDT0000 complete [ 2675.749330] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2678.346742] LustreError: 111850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780329492 with bad export cookie 879938268783952428 [ 2678.354995] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2678.403682] Lustre: server umount lustre-OST0000 complete [ 2680.666812] Lustre: server umount lustre-OST0001 complete [ 2685.441178] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 11:58:19 (1780329499) [ 2690.344499] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 2702.835690] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 11:58:36 (1780329516) [ 2724.199869] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 2728.721688] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 2746.410749] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2746.540234] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2746.552687] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2746.610738] Lustre: lustre-MDT0000: new disk, initializing [ 2746.664436] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2746.672134] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2749.147588] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2754.619898] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2754.684868] Lustre: 120161:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2754.726499] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2754.729202] Lustre: Skipped 1 previous similar message [ 2754.767285] Lustre: lustre-MDT0001: new disk, initializing [ 2754.832844] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2754.854392] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2754.857693] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2756.529250] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2760.410559] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2762.122237] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2765.529697] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2765.664765] Lustre: lustre-OST0000: new disk, initializing [ 2765.667228] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2765.671224] Lustre: 121903:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2765.711312] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2768.264200] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2772.166170] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2773.985373] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2774.032537] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2774.037772] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2774.076597] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2775.133979] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 1 sec [ 2776.959870] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2777.078665] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2779.105634] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2779.108656] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2779.114715] Lustre: Skipped 1 previous similar message [ 2779.114844] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2779.123219] Lustre: Skipped 1 previous similar message [ 2784.112806] Lustre: server umount lustre-OST0000 complete [ 2789.346308] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2789.347309] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2789.353621] Lustre: Skipped 1 previous similar message [ 2789.358442] Lustre: Skipped 1 previous similar message [ 2792.161079] Lustre: server umount lustre-MDT0000 complete [ 2793.765885] LustreError: 120938:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780329607 with bad export cookie 879938268783953667 [ 2793.766326] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2793.770861] LustreError: 120938:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 2793.905568] Lustre: server umount lustre-MDT0001 complete [ 2797.035788] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 12:00:11 (1780329611) [ 2799.533993] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2799.765025] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2801.329568] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2805.009219] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2806.933916] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2809.270910] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2810.669195] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2813.503344] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2815.901709] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 2818.386310] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2831.463645] Lustre: *** cfs_fail_loc=159, val=0*** [ 2847.925654] Lustre: lustre-MDT0000: Client 4c43b647-728b-4dbd-940d-bb18eafb9960 (at 192.168.202.34@tcp) reconnecting [ 2848.650051] Lustre: *** cfs_fail_loc=159, val=0*** [ 2848.651920] Lustre: Skipped 5 previous similar messages [ 2865.073854] Lustre: lustre-MDT0000: Client 4c43b647-728b-4dbd-940d-bb18eafb9960 (at 192.168.202.34@tcp) reconnecting [ 2870.250775] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2870.260775] LustreError: Skipped 1 previous similar message [ 2870.270633] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2870.294090] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2871.438890] Lustre: server umount lustre-OST0000 complete [ 2876.903837] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2876.916259] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2878.435701] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2878.442743] Lustre: Skipped 2 previous similar messages [ 2882.598466] Lustre: server umount lustre-MDT0000 complete [ 2883.553455] LustreError: 124176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2883.590200] LustreError: 124176:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2887.978501] LustreError: 124156:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780329702 with bad export cookie 879938268783954577 [ 2887.997858] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2888.009768] LustreError: 124156:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2898.999375] Lustre: server umount lustre-MDT0001 complete [ 2931.755199] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 2937.369047] Key type lgssc unregistered [ 2937.833641] LNet: 127655:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2937.847762] LNetError: 127655:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2938.931118] LNet: Removed LNI 192.168.202.134@tcp [ 2940.132563] Key type .llcrypt unregistered [ 2940.135368] Key type ._llcrypt unregistered [ 2980.667369] Key type ._llcrypt registered [ 2980.669479] Key type .llcrypt registered [ 2980.768747] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 2982.134876] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2982.242182] alg: No test for adler32 (adler32-zlib) [ 2983.393282] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 2983.705355] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 2985.444111] Key type lgssc registered [ 2987.111737] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2995.499724] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2995.509534] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2997.119099] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3003.341608] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3007.461758] LustreError: 129055:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3007.514236] LustreError: 129055:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3012.581989] LustreError: 129056:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3014.493227] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3015.189855] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3020.731490] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3026.749955] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3031.366096] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3038.592109] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3039.064075] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3042.183245] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3046.439303] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3052.789647] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3061.991195] Lustre: *** cfs_fail_loc=159, val=0*** [ 3077.371091] Lustre: lustre-MDT0000: Client f75c279f-c0c5-4cde-9ec9-17ed369cd1e1 (at 192.168.202.34@tcp) reconnecting [ 3079.816854] Lustre: *** cfs_fail_loc=159, val=0*** [ 3095.297059] Lustre: lustre-MDT0001: Client f75c279f-c0c5-4cde-9ec9-17ed369cd1e1 (at 192.168.202.34@tcp) reconnecting [ 3096.895786] Lustre: *** cfs_fail_loc=159, val=0*** [ 3096.897297] Lustre: Skipped 3 previous similar messages [ 3113.211111] Lustre: lustre-MDT0001: Client f75c279f-c0c5-4cde-9ec9-17ed369cd1e1 (at 192.168.202.34@tcp) reconnecting [ 3117.645953] Lustre: 131757:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3119.890413] Lustre: *** cfs_fail_loc=159, val=0*** [ 3119.896560] Lustre: Skipped 4 previous similar messages [ 3135.725587] Lustre: lustre-MDT0000: Client 19afabb8-ef14-4f9f-9963-94fb2cfbeeb0 (at 192.168.202.34@tcp) reconnecting [ 3137.253758] Lustre: *** cfs_fail_loc=159, val=0*** [ 3137.262944] Lustre: Skipped 13 previous similar messages [ 3153.670355] Lustre: lustre-MDT0000: Client 19afabb8-ef14-4f9f-9963-94fb2cfbeeb0 (at 192.168.202.34@tcp) reconnecting [ 3155.408727] Lustre: 132049:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3173.345906] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3173.359946] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3173.391060] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3175.416986] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3175.417614] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3176.573457] Lustre: server umount lustre-OST0000 complete [ 3180.513962] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3180.528191] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3180.536859] Lustre: Skipped 1 previous similar message [ 3180.547216] Lustre: Skipped 1 previous similar message [ 3185.636251] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3185.652813] Lustre: Skipped 2 previous similar messages [ 3187.002340] Lustre: server umount lustre-MDT0000 complete [ 3190.775744] LustreError: 129768:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3190.809296] LustreError: 129768:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3191.850624] LustreError: 129035:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780330005 with bad export cookie 4279424686143009683 [ 3191.856224] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3191.859369] LustreError: 129035:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3192.164375] Lustre: server umount lustre-MDT0001 complete [ 3205.637102] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 3209.344990] Key type lgssc unregistered [ 3209.825910] LNet: 133108:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3209.840493] LNetError: 133108:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3209.861937] LNet: Removed LNI 192.168.202.134@tcp [ 3210.920440] Key type .llcrypt unregistered [ 3210.924207] Key type ._llcrypt unregistered [ 3240.956345] Key type ._llcrypt registered [ 3240.958761] Key type .llcrypt registered [ 3241.104984] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 3242.389749] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3242.419523] alg: No test for adler32 (adler32-zlib) [ 3243.424706] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 3243.679167] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 3245.320725] Key type lgssc registered [ 3246.691360] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3256.685663] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3256.713635] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3258.475162] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3265.490100] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3268.133365] LustreError: 134510:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3268.187885] LustreError: 134510:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3273.193497] LustreError: 134509:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3276.106059] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3276.766020] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3284.558217] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3292.284080] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3296.651584] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3306.786639] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3307.100359] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3317.595682] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3321.489790] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3328.153364] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3328.758165] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3335.990960] Lustre: 136758:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3339.879904] Lustre: 136806:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3341.697924] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3343.057532] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3348.287198] Lustre: 136953:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3349.612580] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3351.177248] Lustre: 137062:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3357.666271] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3357.680594] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3357.709346] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3359.715842] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3359.725079] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3359.727643] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3359.756823] Lustre: Skipped 1 previous similar message [ 3361.026777] Lustre: server umount lustre-OST0000 complete [ 3368.929774] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3368.945706] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3368.969110] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3371.553390] Lustre: server umount lustre-MDT0000 complete [ 3375.076941] LustreError: 135383:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3375.108438] LustreError: 135383:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3375.680043] LustreError: 134491:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780330189 with bad export cookie 8272388279519074737 [ 3375.711258] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3376.152305] Lustre: server umount lustre-MDT0001 complete [ 3387.888183] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 3390.651641] Key type lgssc unregistered [ 3390.962468] LNet: 138102:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3390.971474] LNetError: 138102:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3392.051229] LNet: Removed LNI 192.168.202.134@tcp [ 3393.022080] Key type .llcrypt unregistered [ 3393.026186] Key type ._llcrypt unregistered [ 3416.179757] Key type ._llcrypt registered [ 3416.183210] Key type .llcrypt registered [ 3416.288836] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 3417.591737] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3417.620301] alg: No test for adler32 (adler32-zlib) [ 3418.797703] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 3419.082075] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 3420.784531] Key type lgssc registered [ 3422.125160] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3430.582233] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3430.611412] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3432.113095] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3436.002961] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3442.671489] LustreError: 139500:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3442.698076] LustreError: 139500:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3443.794755] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3444.347410] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3448.867275] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3454.598649] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3458.037478] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3464.140879] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3464.494278] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3469.618019] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3470.444439] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3474.731761] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3477.810384] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3484.860146] Lustre: *** cfs_fail_loc=159, val=0*** [ 3500.265466] Lustre: lustre-MDT0000: Client b9df8080-5525-44d7-ac6c-2791f14ba487 (at 192.168.202.34@tcp) reconnecting [ 3505.636706] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3505.643774] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3505.659478] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3506.161540] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 3506.163851] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3506.174883] LustreError: Skipped 2 previous similar messages [ 3506.207573] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3506.369422] Lustre: server umount lustre-OST0000 complete [ 3510.753416] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3510.760067] LustreError: Skipped 5 previous similar messages [ 3510.765408] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3510.796552] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3513.826680] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3513.827841] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3513.858631] Lustre: Skipped 1 previous similar message [ 3515.340555] Lustre: server umount lustre-MDT0000 complete [ 3518.745752] LustreError: 139479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780330332 with bad export cookie 11280329158349164721 [ 3518.758531] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3518.761702] LustreError: 139479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3519.037799] Lustre: server umount lustre-MDT0001 complete [ 3528.009879] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 3530.411536] Key type lgssc unregistered [ 3530.645751] LNet: 142805:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3530.651616] LNetError: 142805:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3531.687938] LNet: Removed LNI 192.168.202.134@tcp [ 3532.406077] Key type .llcrypt unregistered [ 3532.408180] Key type ._llcrypt unregistered [ 3554.816896] Key type ._llcrypt registered [ 3554.819533] Key type .llcrypt registered [ 3554.918179] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 3555.948092] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3555.972039] alg: No test for adler32 (adler32-zlib) [ 3556.995731] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 3557.200368] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 3558.875268] Key type lgssc registered [ 3559.735698] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3566.059071] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3566.105370] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3567.651599] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3571.693480] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3577.832404] LustreError: 144203:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3577.843567] LustreError: 144203:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3578.800399] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3579.109047] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3583.127209] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3588.305229] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3591.229526] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3596.603531] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3596.886316] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3601.471083] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3604.077864] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3605.330378] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3612.278704] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3632.134603] Lustre: lustre-MDT0001: evicting 5249aa18-7e3f-4351-bf0f-05ec16ce5ec3 (at 192.168.202.34@tcp) by administrative request [ 3632.141326] Lustre: Skipped 1 previous similar message [ 3658.722055] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3658.725593] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3658.730439] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3660.771444] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3660.775305] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3660.786431] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3661.796201] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3661.801434] Lustre: Skipped 1 previous similar message [ 3664.188687] Lustre: server umount lustre-OST0000 complete [ 3666.917332] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3666.928582] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3671.521188] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3671.526862] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3671.540939] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3672.748757] Lustre: server umount lustre-MDT0000 complete [ 3674.761441] LustreError: 144185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780330488 with bad export cookie 15268034195355638267 [ 3674.765774] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3674.767201] LustreError: 144185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3674.931093] Lustre: server umount lustre-MDT0001 complete [ 3680.095031] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 3681.505510] Key type lgssc unregistered [ 3681.690815] LNet: 147935:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3681.694924] LNetError: 147935:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3681.710534] LNet: Removed LNI 192.168.202.134@tcp [ 3682.136923] Key type .llcrypt unregistered [ 3682.139317] Key type ._llcrypt unregistered [ 3719.259508] Key type ._llcrypt registered [ 3719.260763] Key type .llcrypt registered [ 3719.317464] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 3719.859475] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3719.877233] alg: No test for adler32 (adler32-zlib) [ 3720.797330] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 3720.911974] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 3722.537284] Key type lgssc registered [ 3723.027967] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3726.780104] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3726.788426] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3728.059465] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3730.096782] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3734.370709] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3734.521681] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3736.431176] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3740.219918] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3743.782435] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3751.852631] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3752.072441] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3753.088298] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3759.225167] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3759.723525] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3767.347958] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3775.857711] Lustre: server umount lustre-OST0000 complete [ 3785.198522] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3785.212419] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3785.228141] Lustre: Skipped 1 previous similar message [ 3785.247165] Lustre: Skipped 1 previous similar message [ 3790.335693] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3790.340345] Lustre: Skipped 1 previous similar message [ 3791.518454] Lustre: server umount lustre-MDT0000 complete [ 3795.426881] LustreError: 150382:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3795.472424] LustreError: 150382:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3796.450730] Lustre: 149693:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780330594/real 1780330594] req@00000000b0635a0c x1866811871096320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 1 dl 1780330610 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3796.503274] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3796.520296] LustreError: 150378:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3796.558957] LustreError: 150378:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3797.596764] LustreError: 152542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780330611 with bad export cookie 4833851453163180039 [ 3797.606232] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3797.630180] LustreError: 152542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3798.517632] Lustre: server umount lustre-MDT0001 complete [ 3816.197886] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 3819.752545] Key type lgssc unregistered [ 3820.047619] LNet: 153567:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3820.052842] LNetError: 153567:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3820.071813] LNet: Removed LNI 192.168.202.134@tcp [ 3821.178647] Key type .llcrypt unregistered [ 3821.205627] Key type ._llcrypt unregistered [ 3852.564523] Key type ._llcrypt registered [ 3852.567137] Key type .llcrypt registered [ 3852.684896] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 3854.288120] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3854.325089] alg: No test for adler32 (adler32-zlib) [ 3855.448300] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 3855.645631] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 3857.320175] Key type lgssc registered [ 3858.597717] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3875.999874] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 12:18:08 (1780330688) [ 3895.339886] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 3905.835420] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 3951.029704] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3951.081840] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3952.485228] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3952.547922] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3952.745130] Lustre: lustre-MDT0000: new disk, initializing [ 3952.880119] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3952.915229] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3958.067098] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3970.636329] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3970.765469] Lustre: 157792:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3970.839927] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3970.844859] Lustre: Skipped 1 previous similar message [ 3970.906887] Lustre: lustre-MDT0001: new disk, initializing [ 3971.106963] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3971.196458] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3971.218458] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3977.822149] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 3986.114243] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3991.178634] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3999.582477] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3999.998897] Lustre: lustre-OST0000: new disk, initializing [ 4000.010336] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4000.024595] Lustre: 159538:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4000.157986] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4007.025089] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4007.035321] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4007.240982] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4007.920713] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 4016.740422] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4027.874113] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4027.901278] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4027.902410] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4027.934935] Lustre: Skipped 1 previous similar message [ 4032.904223] Lustre: server umount lustre-OST0000 complete [ 4037.602199] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4037.608864] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4037.621268] Lustre: Skipped 1 previous similar message [ 4037.631522] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4043.207339] Lustre: server umount lustre-MDT0000 complete [ 4047.882424] LustreError: 158582:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780330862 with bad export cookie 14609631426440038363 [ 4047.893404] LustreError: 158582:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4047.898711] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4048.510759] Lustre: server umount lustre-MDT0001 complete [ 4061.634378] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 4065.496740] Key type lgssc unregistered [ 4065.935286] LNet: 161315:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4065.951697] LNetError: 161315:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4065.973585] LNet: Removed LNI 192.168.202.134@tcp [ 4067.050525] Key type .llcrypt unregistered [ 4067.052810] Key type ._llcrypt unregistered [ 4100.636174] Key type ._llcrypt registered [ 4100.643645] Key type .llcrypt registered [ 4100.906131] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 4102.943964] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4103.222568] alg: No test for adler32 (adler32-zlib) [ 4105.118108] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 4105.703905] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 4107.600562] Key type lgssc registered [ 4108.870308] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4120.024697] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4120.061669] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4121.819558] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4126.544262] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 4131.320523] LustreError: 162713:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4131.356361] LustreError: 162713:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4136.157434] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4136.422673] LustreError: 162714:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4136.709752] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4141.732668] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 4147.903262] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4152.702892] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4160.021754] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4160.437360] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4166.600162] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4167.480360] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 4174.751644] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4181.649134] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4181.687529] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4181.727370] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4181.742521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.769524] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4182.880284] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4182.916930] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4182.927037] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4182.932670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.967470] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4184.254527] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4184.269775] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4184.275125] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4184.279977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.284487] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4185.210147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.255536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.191418] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4187.198422] Lustre: Skipped 2 previous similar messages [ 4187.244194] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4187.268504] Lustre: Skipped 2 previous similar messages [ 4187.279411] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4187.290034] Lustre: Skipped 2 previous similar messages [ 4187.294787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.309229] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4187.330218] Lustre: Skipped 2 previous similar messages [ 4188.360903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.375825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.532488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.556190] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4191.567812] Lustre: Skipped 3 previous similar messages [ 4191.588478] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4191.601177] Lustre: Skipped 3 previous similar messages [ 4191.605530] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4191.610479] Lustre: Skipped 3 previous similar messages [ 4191.614508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.629271] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4191.635411] Lustre: Skipped 3 previous similar messages [ 4192.701136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.823065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4194.737652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.766651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.826760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.891195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.024563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.152760] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4200.160413] Lustre: Skipped 7 previous similar messages [ 4200.183962] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4200.194423] Lustre: Skipped 7 previous similar messages [ 4200.201855] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4200.208221] Lustre: Skipped 7 previous similar messages [ 4200.210678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.219195] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4200.230616] Lustre: Skipped 7 previous similar messages [ 4201.153471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.427930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.433198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.645757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.778217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.114725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.277469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.352945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.095429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.237149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.051259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.290888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.296568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.246303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.874906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.677801] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4216.685753] Lustre: Skipped 15 previous similar messages [ 4216.696105] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4216.705866] Lustre: Skipped 15 previous similar messages [ 4216.708621] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4216.711107] Lustre: Skipped 15 previous similar messages [ 4216.713798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.719051] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4216.721419] Lustre: Skipped 15 previous similar messages [ 4217.694755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.206095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.576783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.744513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.069724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.373789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.562697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.865789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.987153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.691507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.126599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.464842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.720715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.933094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4236.032508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.123708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.413534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.758534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.195531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.465984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.760354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4245.139773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.610133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.140334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.400312] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4249.409881] Lustre: Skipped 24 previous similar messages [ 4249.431822] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4249.450397] Lustre: Skipped 24 previous similar messages [ 4249.456033] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4249.459163] Lustre: Skipped 24 previous similar messages [ 4249.468939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.479672] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4249.505058] Lustre: Skipped 24 previous similar messages [ 4250.891288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4252.048543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.446703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.715321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.712268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4257.000566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4258.450536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.719444] LustreError: 162733:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4259.752060] LustreError: 162733:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4259.760066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.802953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.014470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.293204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4264.660225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.101333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.237691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4268.224711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.352986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.459237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.751678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4272.948620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.062569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.239556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.271654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4277.286333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.263862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.357891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.558493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.633704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4282.731876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.906453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4284.902305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.033334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.238526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4288.262408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.283793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4290.221359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.428687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.541024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4293.662641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4294.755700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.942266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4296.829741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.019624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.054739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.207537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.793096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.036288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.231627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.500746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4306.731751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4307.902300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.212945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4310.438188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.701960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4312.818838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4313.961873] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4313.968485] Lustre: Skipped 54 previous similar messages [ 4313.994695] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4314.008482] Lustre: Skipped 54 previous similar messages [ 4314.014682] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4314.021407] Lustre: Skipped 54 previous similar messages [ 4314.025520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4314.039399] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4314.042193] Lustre: Skipped 54 previous similar messages [ 4315.259177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4316.326709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4317.394249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4318.498809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4319.506452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4320.789775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.524870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4322.608780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4323.567229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4324.646453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4325.852531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4326.970611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.048725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.954040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.121729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4331.072291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.076689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4333.181297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.258123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4335.161307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4336.080963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4337.252496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4338.295861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.326908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4340.651509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4341.632815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4342.731846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4344.023657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4345.192890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4346.188955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.080910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4348.286624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.246412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4350.221242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4351.183628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4352.395185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.335351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4354.447339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4355.276721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.244517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4357.176977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.438528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4359.394387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4360.502955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.681685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4362.800415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.893691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.997055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.933737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.129894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.278164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.350944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.332805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.368589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.351931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.564783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.422263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.430539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.136354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.111774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.759905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.538443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.351519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.654464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.576327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.850763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.112756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.332741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.547556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.625187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.824579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.810404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.676682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.622305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.711993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.598945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.757070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.688093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.655238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.831718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.892144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.009949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.050326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.004456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.090261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.263433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.255661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.348797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.628171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.653638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.702101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.566644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.703837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.799370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.966911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.105573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.380183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.490346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.772311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.679686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.753308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.107829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.493242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.651374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.774069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.939823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.385373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.231590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.279633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4431.332598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.901434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.183727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.059210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.326280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.763836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.989391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.291292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.707993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.621205] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4442.626759] Lustre: Skipped 118 previous similar messages [ 4442.647368] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4442.657272] Lustre: Skipped 118 previous similar messages [ 4442.666424] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4442.678591] Lustre: Skipped 118 previous similar messages [ 4442.688264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.709250] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4442.711799] Lustre: Skipped 118 previous similar messages [ 4444.036886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.208286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.334616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.233214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.217884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.182880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.221166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.069723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.142276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.128411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.271237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.213549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.300152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.320053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.307927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.210229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.229619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.041429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.942599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.767534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.715900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.500361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.564584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.794574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.747278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.742420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.639651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.560160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.434972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.591545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.486734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4474.558581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4475.530535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4476.723504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4477.733723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4478.746419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.591312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.665960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.592434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4482.751587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4483.599425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.609862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4485.441879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4486.435437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.555644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4488.414116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.562464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4490.606808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.736410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4492.621079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.678523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4494.559527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4495.645477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4496.633199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.769908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4498.497758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.308440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4500.110787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.028367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.773848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4502.810983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.820299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4504.985567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4506.008762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4507.140842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4508.153783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4509.058467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.190088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4511.390379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4512.401498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.604472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4514.480343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4515.550269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4516.724063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.793518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.810211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4519.927072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4520.994589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.128433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4523.202710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4524.562410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4525.628793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4526.753859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.962601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4529.046771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4530.335734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.269266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.523457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4533.466844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4534.626244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4535.577954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4536.764588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4537.557198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.740162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4539.745259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.788117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4541.568320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4542.466594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4543.605029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4544.630455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4545.323695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4546.359009] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4547.221836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4548.324083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4549.225661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4550.561137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.481434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4552.872688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4554.194018] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4555.179438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.036757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.828119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4557.853315] LustreError: 162733:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4557.865334] LustreError: 162733:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4557.880246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4559.637511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.386966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4562.703561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4563.995683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4565.121791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4566.361669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4567.502236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4568.628843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4569.958629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4570.907264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4572.076915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4573.070960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4574.208515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4575.114341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4576.398974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4577.368195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4578.544670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4579.621085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4580.593887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4581.629929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4582.834958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4584.048612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4585.172707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4586.122148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4587.598057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4588.912336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4590.175316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4591.063067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4592.187954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4593.281959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4594.564717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4595.634743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4596.748117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4597.673627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4598.820768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4599.745375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4600.855173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4601.813564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4602.915699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4603.869282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4605.101244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4605.937910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4606.785527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4607.786592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4609.100622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4610.056764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4611.059421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.043930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4613.039407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4614.022812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4615.187665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4616.154370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4616.959822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4617.677549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.728559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4619.614794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4621.042541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4621.972478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4622.971575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.855091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4624.966993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4626.013426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4627.063481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4628.028320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4629.226049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4630.062782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.056765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.972153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4633.053184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4634.066636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4635.196444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4636.181117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4637.114282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4638.017694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.027737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.912528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4640.867907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.823076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4642.831692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4643.855466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4644.853939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.009097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.929118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4647.836660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.795534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4649.720430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.557300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4651.515037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.471164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.257967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4654.167644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.002938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.850510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.935650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4657.783859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.854984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.713070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.699818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4661.731966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.759396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4663.835688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4665.040040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.192962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.496259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.618800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.943257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4670.992057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.379809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.010228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.132852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4676.186450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.667685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.898867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.695618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.210689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.404714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.083356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.209391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.209951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.421747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4687.581270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.602075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.836826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.847053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4691.840626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.763259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.595676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.272236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.047825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.592244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.344936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.076387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.287881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.351459] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4699.359782] Lustre: Skipped 246 previous similar messages [ 4699.382631] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4699.396176] Lustre: Skipped 246 previous similar messages [ 4699.401077] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4699.403994] Lustre: Skipped 246 previous similar messages [ 4699.411706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.430735] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4699.446049] Lustre: Skipped 246 previous similar messages [ 4700.637753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.779225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.754856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.888734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.102937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.335778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4707.358702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.798197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.131754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.341541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4712.767514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.062172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4715.311379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.884310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.656105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4719.922723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.338202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.589297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4724.115137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.446406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.477533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.866843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.971638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.835953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.525828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.224765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4732.166284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.180839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.030099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.947472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.781752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.594547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.216960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.774648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.494448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.317684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.041841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.083832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4742.058274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.045394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4744.247198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.340332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.429430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.435348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.504517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.706535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.903591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4752.092757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4753.164120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4754.282662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4755.438358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4756.355823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4757.376724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4758.231513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4759.245894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4760.321678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4761.431711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4762.249840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4763.211494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4764.127271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4765.178937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4766.279485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.363655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4768.348994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4769.614741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4770.714510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4771.889617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4773.077153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4774.144610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4775.340749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4776.410035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4777.415976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4778.579906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4779.547692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4780.554355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4781.676838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4782.770073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4784.058358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4785.274883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4786.533458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4787.891656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4789.311365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4790.165677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4791.034538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4791.999384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4793.061538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4793.924933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4794.966634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4795.965372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4797.138762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4798.315830] LustreError: 162733:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4798.319503] LustreError: 162733:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4798.329323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4799.737509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.822197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4801.890271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4803.115203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.311882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4805.501902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4806.724381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4808.111276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4809.160802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.614067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4811.649810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4812.764281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.914286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.098387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4816.212759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.368667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.399240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.874501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.070259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.045351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.148968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4824.343509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.409351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.499567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.589076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.497072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.714900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.711050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.836551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.997226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.199862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.262580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.341953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.500985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.656093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.869096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.060578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.125722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.130619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.415857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.724768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.804417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.966442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.129987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.254191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.122523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.409683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.685441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.713421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4855.876857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.153752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.147416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.019985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.791569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.767302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.788390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.971921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.206383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.354826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.450663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.698212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.590640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.828966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.929266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.861543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.055724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.214132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.161951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.241269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.307223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.431893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.281092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.248650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.180458] LustreError: 162733:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4881.196881] LustreError: 162733:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4881.209692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.194845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.308144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.318768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.496611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.619676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.699162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.528761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.470309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.441968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.260741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.321854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.208658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.177324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.178951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.318773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.361772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.439099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.727540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.757382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4901.977919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.215293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.357563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.462376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.458497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.562217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.531031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.675803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.515350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.496604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.616681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.484895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.563097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.557838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.503810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.507990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.793443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.863467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.776271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.734801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.485348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.548638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.555060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.543824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.563680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.697777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.797434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.914272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.949991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.128338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.406601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.428470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.622203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.517129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.749060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4938.843308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.782754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.944599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4941.815812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4943.060611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.350403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.641613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.708894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.903828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.054853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.197858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.475176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.583475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4953.862643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.943089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.950765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.091597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.203874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.113926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.268474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.419378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.522036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.581300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.522065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.484913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.510128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.423320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.483238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.261553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.053833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.956361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.069090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4973.282165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.110541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.211414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.271774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.363449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.545976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.638436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.929778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4982.073638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.336688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.213024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.114280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.111539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.132967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.066703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.416464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.292113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.295111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.492051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.646525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.741724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.996788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.912447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.008066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.068824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.979799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.924179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.948177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.891258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.852888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.967688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.988109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.832288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.019074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.993930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.028123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.229826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.271544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.303098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.374268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.426446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.651776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.779450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.726865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.041113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.337825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.630636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.786553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.838573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.837736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.884711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.777804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.784625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.741787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.964852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.131277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.268922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.522568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.770536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.960840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.348421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.285159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.325756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.261352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.403367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.482205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.774090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.846898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.946704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.152035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.064403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.100905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.000262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.116072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.132060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.183377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.034157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.995304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.888357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.160089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.281035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.324653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.431918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.517568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.784909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.981347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.023309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.263147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.159224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.233323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.325249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.125033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.165125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.161416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.663851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.910702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.060092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.126744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.129941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.319225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.382381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.383802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.491626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.590153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.760357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.022547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.074150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.002321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.016918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.309792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.324103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5093.398118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.455837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.480518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.554144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.527683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.478596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.619604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.533457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.788208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.792830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.765520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.712685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.864490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.199611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.635112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.536399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.461089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.076871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.135926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.026892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.415809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.264614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.403529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.479098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.297135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.453288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.239611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.230597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.184183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.221928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.300800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.369396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.339453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.610340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.666415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5129.875475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.374617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.780147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.422297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.562247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.412715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.586992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.134799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.213824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.248643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.389095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.451768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.605813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.958300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.911726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.713812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.826715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.866953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.025892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.828316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.652426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.951236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.743525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.057271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.298868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.599051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.732276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.222748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.487114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.470450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.387897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.088062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.798707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.651848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.749870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.834298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.692976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.733862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.673217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.802452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.752857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.986509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.165076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.061679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.094820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.161697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.471317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.684308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.647034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.013408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.132066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.097838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.277650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.455408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.532763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.737321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.881272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.955977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.073259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.153209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.329696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.262459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.377713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.498335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.843362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.976665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.089233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.987355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.169078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.072907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.328461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.205530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.206550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.386811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.469256] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5211.483840] Lustre: Skipped 471 previous similar messages [ 5211.524048] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5211.534156] Lustre: Skipped 471 previous similar messages [ 5211.538490] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5211.541516] Lustre: Skipped 471 previous similar messages [ 5211.545662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.555424] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5211.565214] Lustre: Skipped 471 previous similar messages [ 5212.588951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.829569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5214.848594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.052798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.323552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.573615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.719806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.613417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.608978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.627865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.554773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.517952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.475759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.490885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.588632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.822884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.690902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.715482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.723704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.968749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.952058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.863492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.021307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.842230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.883258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.973544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.939498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.092964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.426346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.488257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.449224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.510771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.821977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.997122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.065594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.099840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.283946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.684939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.959259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.141133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.133633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.306410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.220489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.316559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.363163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.602381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.968699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.182069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.174503] LustreError: 164606:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 5647.186142] LustreError: 162733:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6291.438960] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6291.441606] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6291.477026] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6291.523410] Lustre: Skipped 49 previous similar messages [ 6296.554370] LustreError: 216433:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6296.589699] LustreError: 216433:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6296.780813] Lustre: server umount lustre-OST0000 complete [ 6302.689932] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6302.700891] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6302.709504] Lustre: Skipped 1 previous similar message [ 6306.786446] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6306.796902] Lustre: Skipped 1 previous similar message [ 6308.692940] Lustre: server umount lustre-MDT0000 complete [ 6311.939143] LustreError: 162713:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6311.980215] LustreError: 162713:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6314.311054] LustreError: 162693:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780333128 with bad export cookie 11093249893295235944 [ 6314.317542] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6314.321162] LustreError: 162693:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6315.247859] Lustre: server umount lustre-MDT0001 complete [ 6328.972265] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 6333.250149] Key type lgssc unregistered [ 6333.825917] LNet: 217629:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6333.849207] LNetError: 217629:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6333.874059] LNet: Removed LNI 192.168.202.134@tcp [ 6335.078223] Key type .llcrypt unregistered [ 6335.082692] Key type ._llcrypt unregistered [ 6365.506468] Key type ._llcrypt registered [ 6365.512383] Key type .llcrypt registered [ 6365.717326] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 6367.535355] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6367.739708] alg: No test for adler32 (adler32-zlib) [ 6369.041708] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 6369.358331] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 6371.072174] Key type lgssc registered [ 6372.229742] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6383.133516] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6383.175546] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6384.893707] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6390.284717] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6394.348471] LustreError: 219031:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6394.369855] LustreError: 219031:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6399.484605] LustreError: 219032:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6401.684782] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6402.110988] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6408.859602] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6417.545873] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6421.499669] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6429.612512] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6429.733226] LustreError: 220628:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6429.896890] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6435.318115] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 6436.358645] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6442.868640] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6452.436566] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6454.686337] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6454.704557] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6454.717339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6454.733276] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6454.735745] LustreError: 219051:0:(osp_precreate.c:1264:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6457.844702] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6457.857129] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6457.881193] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6460.907769] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6460.909911] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6460.934963] Lustre: Skipped 1 previous similar message [ 6463.930359] Lustre: server umount lustre-OST0000 complete [ 6474.832146] LustreError: 219051:0:(osp_precreate.c:1264:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6500.097041] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6500.615537] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6501.675073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6501.690526] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6508.223560] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6510.901938] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6510.917741] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 6515.125767] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6517.125514] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6521.894915] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff91ca468af800.ost_server_uuid 50 [ 6523.947386] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff91ca468af800.ost_server_uuid in FULL state after 0 sec [ 6529.509283] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6529.526307] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6529.550343] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6529.555183] Lustre: Skipped 1 previous similar message [ 6531.566273] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6535.670707] Lustre: server umount lustre-OST0000 complete [ 6540.258145] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6540.266415] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6540.274096] Lustre: Skipped 1 previous similar message [ 6540.276545] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6540.283959] Lustre: Skipped 1 previous similar message [ 6546.695503] Lustre: server umount lustre-MDT0000 complete [ 6546.918073] LustreError: 219924:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6546.962763] LustreError: 219924:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6551.017348] LustreError: 219028:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6551.063541] LustreError: 219028:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6551.930431] LustreError: 222949:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780333366 with bad export cookie 2821692452094939585 [ 6551.941252] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6551.958725] LustreError: 222949:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6552.395175] Lustre: server umount lustre-MDT0001 complete [ 6568.014796] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 6571.943375] Key type lgssc unregistered [ 6572.304786] LNet: 223684:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6572.318361] LNetError: 223684:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6573.360075] LNet: Removed LNI 192.168.202.134@tcp [ 6574.645662] Key type .llcrypt unregistered [ 6574.652377] Key type ._llcrypt unregistered [ 6615.393197] Key type ._llcrypt registered [ 6615.403561] Key type .llcrypt registered [ 6615.534798] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 6616.790956] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6617.006911] alg: No test for adler32 (adler32-zlib) [ 6618.200863] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 6618.542061] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 6620.282608] Key type lgssc registered [ 6621.929440] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6633.858958] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6633.902113] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6635.727229] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6642.453800] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6645.224564] LustreError: 225400:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6645.258779] LustreError: 225400:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6650.349420] LustreError: 225399:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6652.751483] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6653.307778] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6658.116356] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6661.859160] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6670.414981] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6670.864578] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6677.999549] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6680.118382] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 6688.023652] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6688.224756] Lustre: lustre-OST0001: new disk, initializing [ 6688.230429] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6688.236221] Lustre: 227662:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6688.321560] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6693.972066] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6693.982309] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6694.038544] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6695.354748] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6707.092732] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6713.250743] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 6730.210922] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6730.211980] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6730.213761] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6730.223728] Lustre: Skipped 3 previous similar messages [ 6735.344197] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6735.356775] Lustre: Skipped 6 previous similar messages [ 6735.779112] Lustre: server umount lustre-MDT0000 complete [ 6740.188037] LustreError: 227659:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780333554 with bad export cookie 1874665967528981992 [ 6740.199806] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6740.425674] Lustre: server umount lustre-MDT0001 complete [ 6754.938122] Lustre: server umount lustre-OST0000 complete [ 6756.832232] Lustre: 224664:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780333554/real 1780333554] req@ffff9ece71b0a680 x1866814908891648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780333570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6756.864714] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6759.281545] Lustre: server umount lustre-OST0001 complete [ 6784.014475] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 6795.749284] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6796.401105] LustreError: 230736:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6796.556217] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6801.889222] LustreError: 230737:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6802.024121] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6805.997033] LustreError: 230736:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6813.287054] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6813.787675] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6819.587937] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6823.846353] Lustre: 231848:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6832.260681] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6832.892458] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6838.004849] LustreError: 232203:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6838.031829] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 6838.041285] LustreError: 232203:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6841.001445] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6841.094320] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 6856.657738] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6856.685479] LustreError: 232202:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6856.701805] LustreError: 232202:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 6864.486387] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6875.623862] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6880.832446] Lustre: 233685:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6895.589236] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6895.597509] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6895.616672] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6898.147336] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6898.153212] Lustre: mylustre-MDT0000-lwp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6902.419379] Lustre: server umount mylustre-MDT0000 complete [ 6903.267123] LustreError: 230736:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6903.300148] LustreError: 230736:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6906.094363] LustreError: 232227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780333720 with bad export cookie 1874665967528984855 [ 6906.096501] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6906.102143] LustreError: 232227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 6906.454464] Lustre: server umount mylustre-MDT0001 complete [ 6922.317575] Lustre: server umount mylustre-OST0000 complete [ 6924.580708] Lustre: 224661:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780333722/real 1780333722] req@ffff9ecd4260c700 x1866814908962176/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780333738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6924.605969] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6924.617947] Lustre: Skipped 2 previous similar messages [ 6926.260981] Lustre: server umount mylustre-OST0001 complete [ 6952.688294] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 6964.443116] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6965.290812] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6965.298114] Lustre: Skipped 1 previous similar message [ 6969.433463] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6970.347468] LustreError: 235979:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6970.358699] LustreError: 235979:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6980.349684] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6985.844661] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 6989.779573] Lustre: 237089:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6997.496975] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7003.310779] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7004.922650] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:161) [ 7010.085990] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 7014.387796] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7020.072979] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:65) [ 7022.510535] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7031.805915] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7036.774961] Lustre: 238927:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7045.610028] Lustre: tfs-MDT0000-lwp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7045.613325] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7045.626387] Lustre: Skipped 2 previous similar messages [ 7045.634720] Lustre: Skipped 6 previous similar messages [ 7051.269475] Lustre: server umount tfs-MDT0000 complete [ 7054.886495] LustreError: 235956:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780333869 with bad export cookie 1874665967528986808 [ 7054.902783] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7055.376900] Lustre: server umount tfs-MDT0001 complete [ 7069.320954] Lustre: server umount tfs-OST0000 complete [ 7071.205176] Lustre: 224663:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780333869/real 1780333869] req@ffff9ecd5f1d7100 x1866814909015552/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780333885 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7071.230572] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7071.245059] Lustre: Skipped 1 previous similar message [ 7073.491414] Lustre: server umount tfs-OST0001 complete [ 7097.482478] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 7110.081131] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7110.726622] LustreError: 241164:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7110.747268] LustreError: 241164:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 7110.837596] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7110.849232] Lustre: Skipped 3 previous similar messages [ 7115.130584] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7124.101478] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7129.877203] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7133.086405] Lustre: 242273:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7139.895407] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7146.820058] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7149.635377] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:193) [ 7155.704020] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 7156.048571] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7161.381207] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:97) [ 7163.388406] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7170.891813] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7174.432343] Lustre: 244106:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7181.326445] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 13:13:14 (1780333994) [ 7197.158783] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7197.173190] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7197.190981] Lustre: Skipped 2 previous similar messages [ 7197.200281] Lustre: Skipped 5 previous similar messages [ 7203.466389] Lustre: server umount lustre-MDT0000 complete [ 7207.645964] LustreError: 241141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780334021 with bad export cookie 1874665967528988726 [ 7207.653501] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7207.660366] LustreError: 241141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 7214.227139] Lustre: server umount lustre-MDT0001 complete [ 7232.992275] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7233.080447] Lustre: server umount lustre-OST0000 complete [ 7243.479953] Lustre: server umount lustre-OST0001 complete [ 7251.392993] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 7263.492643] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 7306.131086] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7306.131086] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7306.131086] [ 7306.180628] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7306.513392] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7306.548340] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7306.627605] Lustre: lustre-MDT0000: new disk, initializing [ 7306.734288] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7306.740302] Lustre: Skipped 3 previous similar messages [ 7306.757273] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7312.139949] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7322.614583] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 7322.614583] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7322.614583] [ 7322.638561] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7322.726178] Lustre: 247262:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7322.770672] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7322.773758] Lustre: Skipped 1 previous similar message [ 7322.832857] Lustre: lustre-MDT0001: new disk, initializing [ 7322.942407] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7322.951750] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7327.556409] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7337.062503] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7337.340342] Lustre: lustre-OST0000: new disk, initializing [ 7337.343726] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7337.348917] Lustre: 248815:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7339.133599] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7339.143905] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7339.272866] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7343.771547] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7353.672513] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7353.911601] Lustre: lustre-OST0001: new disk, initializing [ 7353.927590] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7353.937731] Lustre: 249666:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7355.449581] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7355.463487] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7355.646651] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7360.889594] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7373.753908] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 13:16:27 (1780334187) [ 7388.591672] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 13:16:41 (1780334201) [ 7406.049557] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7406.051741] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7406.064311] LustreError: Skipped 1 previous similar message [ 7406.068695] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7406.068702] Lustre: Skipped 8 previous similar messages [ 7406.102389] Lustre: Skipped 4 previous similar messages [ 7409.890983] Lustre: server umount lustre-OST0000 complete [ 7412.202691] LustreError: 248797:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7412.218925] LustreError: 248797:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 13 previous similar messages [ 7415.270350] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7420.395371] Lustre: server umount lustre-MDT0000 complete [ 7424.627579] LustreError: 247253:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780334238 with bad export cookie 1874665967528990504 [ 7424.644209] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7424.654940] LustreError: 247253:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7431.245837] Lustre: server umount lustre-MDT0001 complete [ 7444.380575] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 7456.525990] Lustre: server umount lustre-OST0001 complete [ 7466.747504] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 7486.121945] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 7521.625819] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7521.856353] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7521.889656] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7521.955942] Lustre: lustre-MDT0000: new disk, initializing [ 7522.090254] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7526.330653] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7535.519360] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7535.668500] Lustre: 254152:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7535.763369] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7535.767259] Lustre: Skipped 1 previous similar message [ 7535.874401] Lustre: lustre-MDT0001: new disk, initializing [ 7536.013464] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7536.034755] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7540.490676] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7548.671384] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7552.892897] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7560.394151] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7560.907978] Lustre: lustre-OST0000: new disk, initializing [ 7560.911726] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7560.927082] Lustre: 255896:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7562.911922] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7562.947383] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7563.148293] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7568.015992] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7575.806869] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7583.718558] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7583.718889] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7583.729540] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7583.729549] Lustre: Skipped 9 previous similar messages [ 7583.741645] Lustre: Skipped 5 previous similar messages [ 7587.736929] Lustre: server umount lustre-OST0000 complete [ 7592.419607] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7592.430847] LustreError: Skipped 1 previous similar message [ 7598.638523] Lustre: server umount lustre-MDT0000 complete [ 7602.448088] LustreError: 254146:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780334416 with bad export cookie 1874665967528992016 [ 7602.459869] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7602.472457] LustreError: 254146:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7602.841824] Lustre: server umount lustre-MDT0001 complete [ 7614.546350] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 7617.827980] Key type lgssc unregistered [ 7618.093583] LNet: 257527:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7618.104812] LNetError: 257527:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7619.177355] LNet: Removed LNI 192.168.202.134@tcp [ 7620.182327] Key type .llcrypt unregistered [ 7620.189523] Key type ._llcrypt unregistered [ 7647.556029] Key type ._llcrypt registered [ 7647.569414] Key type .llcrypt registered [ 7647.810672] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 7648.848730] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7648.948650] alg: No test for adler32 (adler32-zlib) [ 7650.379486] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 7650.655952] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 7652.328194] Key type lgssc registered [ 7653.839930] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7662.986900] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7663.031369] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7664.747057] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7670.053627] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7674.850293] LustreError: 258981:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7674.874775] LustreError: 258981:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7679.971509] LustreError: 258982:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7680.191447] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7680.652180] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7685.506149] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7693.020928] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7697.813964] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7706.633425] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7707.202760] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7709.251635] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 7716.249544] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7723.664952] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7725.108227] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7729.633586] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7729.642445] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7729.663830] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7730.659111] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7730.665782] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7730.670357] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7730.696931] Lustre: Skipped 1 previous similar message [ 7733.604621] Lustre: server umount lustre-OST0000 complete [ 7740.897566] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7740.900206] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7740.914724] Lustre: Skipped 1 previous similar message [ 7740.923917] Lustre: Skipped 1 previous similar message [ 7743.896448] Lustre: server umount lustre-MDT0000 complete [ 7746.021507] LustreError: 258982:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7746.055861] LustreError: 258982:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7748.097216] LustreError: 258960:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780334562 with bad export cookie 17530412066397754681 [ 7748.101090] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7748.116523] LustreError: 258960:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7748.644151] Lustre: server umount lustre-MDT0001 complete [ 7761.697343] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 7764.591844] Key type lgssc unregistered [ 7764.858863] LNet: 262213:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7764.864762] LNetError: 262213:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7764.881344] LNet: Removed LNI 192.168.202.134@tcp [ 7765.986885] Key type .llcrypt unregistered [ 7765.988664] Key type ._llcrypt unregistered [ 7788.333212] Key type ._llcrypt registered [ 7788.341885] Key type .llcrypt registered [ 7788.593985] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 7790.150930] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7790.384437] alg: No test for adler32 (adler32-zlib) [ 7791.641845] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 7791.956401] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 7793.696215] Key type lgssc registered [ 7795.057698] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7805.383799] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7805.411711] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7820.896552] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7826.016396] LustreError: 263394:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.134@tcp: failed processing log, type 4: rc = -110 [ 7852.768212] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7860.933939] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 7869.172504] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7871.543259] Lustre: server umount lustre-OST0000 complete [ 7891.207879] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 7894.643627] Key type lgssc unregistered [ 7894.964684] LNet: 264897:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7894.972317] LNetError: 264897:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7894.989747] LNet: Removed LNI 192.168.202.134@tcp [ 7896.018180] Key type .llcrypt unregistered [ 7896.023927] Key type ._llcrypt unregistered [ 7944.213390] Key type ._llcrypt registered [ 7944.215873] Key type .llcrypt registered [ 7944.323158] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 7946.086826] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7946.229253] alg: No test for adler32 (adler32-zlib) [ 7947.489344] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 7947.813110] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 7949.570706] Key type lgssc registered [ 7950.701032] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7966.001970] loop0: detected capacity change from 0 to 204800000 [ 7966.118788] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7966.137720] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7966.588873] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7967.872774] loop0: detected capacity change from 0 to 204800000 [ 7968.135311] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7968.149887] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7968.569162] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7969.539205] loop0: detected capacity change from 0 to 204800000 [ 7969.697261] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7969.707970] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7969.845630] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7971.177825] loop0: detected capacity change from 0 to 204800000 [ 7971.491581] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7971.513841] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7971.797968] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7973.444827] loop0: detected capacity change from 0 to 204800000 [ 7973.509382] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7978.563539] loop0: detected capacity change from 0 to 204800000 [ 7978.583500] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7983.797251] loop0: detected capacity change from 0 to 204800000 [ 7983.851573] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7988.533135] loop0: detected capacity change from 0 to 204800000 [ 7988.567511] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7992.974704] loop0: detected capacity change from 0 to 204800000 [ 7993.113289] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7993.167192] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7993.291202] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7993.299675] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 7993.310104] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 7993.320123] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7993.329667] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 7993.337965] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7993.350737] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7993.365941] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 7993.387742] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 7993.398644] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 7993.413176] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 7993.440631] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 7993.467121] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 7993.491905] Lustre: 268296:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8000.596872] Lustre: server umount MGS complete [ 8001.414054] loop0: detected capacity change from 0 to 204800000 [ 8001.529336] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8002.375660] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8002.468752] Lustre: lustre-MDT0000: Aborting client recovery [ 8003.538988] loop1: detected capacity change from 0 to 204800000 [ 8003.772053] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8003.871214] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8003.895725] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8003.915183] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8003.928702] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8003.948889] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8003.963041] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8003.975722] Lustre: 268730:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8004.001119] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8004.289346] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8004.363778] Lustre: lustre-MDT0001: Aborting client recovery [ 8005.307939] loop2: detected capacity change from 0 to 204800000 [ 8005.474745] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8005.617454] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8005.632269] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8005.656054] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8005.671490] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8005.684661] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8005.700229] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8005.715824] Lustre: 268810:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8005.881947] Lustre: Found index 0 for lustre-OST0000, updating log [ 8005.950153] Lustre: 268828:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8006.129536] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8006.160993] Lustre: lustre-OST0000: Aborting recovery [ 8007.297953] loop3: detected capacity change from 0 to 204800000 [ 8007.538430] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8007.696466] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8007.726890] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8007.751889] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8007.781082] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8007.804742] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8007.834677] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8007.850984] Lustre: 268894:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8007.876804] Lustre: Found index 1 for lustre-OST0001, updating log [ 8007.917790] Lustre: 268901:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8008.002130] Lustre: lustre-OST0001: Aborting recovery [ 8012.091959] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8012.144504] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8012.163580] LustreError: 268673:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 8012.181589] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8012.198651] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8014.128203] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8014.133175] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8016.599957] LustreError: 268640:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 4757us: rc = -2 [ 8017.125681] LustreError: 268638:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 558us: rc = -2 [ 8017.168375] LustreError: 268638:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 18 previous similar messages [ 8034.790458] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8034.808710] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8034.810440] Lustre: Skipped 2 previous similar messages [ 8034.831745] Lustre: Skipped 3 previous similar messages [ 8036.977628] Lustre: server umount lustre-MDT0000 complete [ 8038.067790] LustreError: 268622:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780334852 with bad export cookie 1062910294053146175 [ 8038.074818] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8038.078384] LustreError: 268622:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8039.908908] LustreError: 268835:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8039.909935] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8039.911218] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8039.945268] LustreError: 268835:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8039.973333] Lustre: Skipped 2 previous similar messages [ 8043.937031] LustreError: 268835:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8043.938118] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8043.957939] LustreError: 268835:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8043.978792] Lustre: Skipped 2 previous similar messages [ 8044.563386] Lustre: server umount lustre-MDT0001 complete [ 8052.009909] Lustre: server umount lustre-OST0000 complete [ 8059.291675] Lustre: server umount lustre-OST0001 complete [ 8069.859831] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 13:28:02 (1780334882) [ 8106.282949] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 8118.700826] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 8162.598210] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8163.093258] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8163.177783] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8163.320953] Lustre: lustre-MDT0000: new disk, initializing [ 8163.386567] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8163.395357] Lustre: Skipped 1 previous similar message [ 8163.410701] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8168.579592] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8182.072843] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8182.246498] Lustre: 272939:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8182.335703] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8182.346476] Lustre: Skipped 1 previous similar message [ 8182.521873] Lustre: lustre-MDT0001: new disk, initializing [ 8182.695351] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8182.754280] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8182.775495] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8188.220360] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8197.172695] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8202.275762] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8211.290561] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8211.659290] Lustre: lustre-OST0000: new disk, initializing [ 8211.665601] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8211.678223] Lustre: 274683:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8211.834210] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8218.706560] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8218.713165] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8218.843436] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8220.168968] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8229.407379] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8236.985585] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8250.099936] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8252.792980] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8258.461175] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8306.152753] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8306.153052] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8306.165579] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8306.185952] Lustre: Skipped 1 previous similar message [ 8306.206530] Lustre: Skipped 1 previous similar message [ 8311.020745] Lustre: server umount lustre-OST0000 complete [ 8315.882254] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8315.899826] LustreError: Skipped 1 previous similar message [ 8315.909759] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8315.938980] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8321.894689] Lustre: server umount lustre-MDT0000 complete [ 8326.285059] LustreError: 272932:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335140 with bad export cookie 1062910294053148940 [ 8326.286864] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8326.293321] LustreError: 272932:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8326.622222] Lustre: server umount lustre-MDT0001 complete [ 8336.348477] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8341.821952] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8346.996950] Lustre: server umount MGS complete [ 8360.221266] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8360.927192] LustreError: 278283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8361.004083] LustreError: 278296:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8361.119398] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8366.563130] LustreError: 278284:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8366.605581] LustreError: 278284:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8366.814111] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8371.706101] LustreError: 278283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8377.765350] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8384.471363] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8392.065974] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8396.595335] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8404.504816] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8405.188682] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8405.193958] Lustre: Skipped 1 previous similar message [ 8412.425568] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8419.664835] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8452.584556] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8452.594461] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8452.604355] Lustre: Skipped 1 previous similar message [ 8452.609442] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8452.619054] Lustre: Skipped 4 previous similar messages [ 8454.626744] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8457.094437] Lustre: server umount lustre-OST0000 complete [ 8464.866373] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8464.888236] Lustre: Skipped 2 previous similar messages [ 8468.007564] Lustre: server umount lustre-MDT0000 complete [ 8469.985095] LustreError: 278997:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8470.010551] LustreError: 278997:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8472.980301] LustreError: 278265:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335287 with bad export cookie 1062910294053150907 [ 8472.987572] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8473.582466] Lustre: server umount lustre-MDT0001 complete [ 8488.850708] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 8492.159135] Key type lgssc unregistered [ 8492.524929] LNet: 281877:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8492.531868] LNetError: 281877:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8492.579055] LNet: Removed LNI 192.168.202.134@tcp [ 8493.366652] Key type .llcrypt unregistered [ 8493.371423] Key type ._llcrypt unregistered [ 8534.370332] Key type ._llcrypt registered [ 8534.377718] Key type .llcrypt registered [ 8534.544298] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 8550.423408] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 8551.114075] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8551.133104] alg: No test for adler32 (adler32-zlib) [ 8552.155451] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 8552.339206] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 8553.952528] Key type lgssc registered [ 8555.330480] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8593.226748] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8593.259193] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8594.607602] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8594.632248] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8594.685972] Lustre: lustre-MDT0000: new disk, initializing [ 8594.763600] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8594.801467] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8600.604231] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8614.335627] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8614.465064] Lustre: 285800:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8614.587064] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8614.596977] Lustre: Skipped 1 previous similar message [ 8614.690651] Lustre: lustre-MDT0001: new disk, initializing [ 8614.799713] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8614.856252] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8614.863556] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8619.626864] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8627.495585] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8631.930132] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8639.517881] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8639.895554] Lustre: lustre-OST0000: new disk, initializing [ 8639.901536] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8639.917271] Lustre: 287546:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8640.067271] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8647.243836] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8647.260559] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8647.441046] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8647.803533] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8655.629903] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8663.387546] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8675.132325] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8677.206637] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8685.990662] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8734.690972] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8734.693573] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8734.698877] LustreError: Skipped 1 previous similar message [ 8734.699703] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8734.716854] Lustre: Skipped 1 previous similar message [ 8736.437841] Lustre: server umount lustre-OST0000 complete [ 8742.883242] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8742.899516] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8742.918606] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8742.928761] Lustre: Skipped 1 previous similar message [ 8744.929702] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8744.930755] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8747.046842] Lustre: server umount lustre-MDT0000 complete [ 8751.367386] LustreError: 289120:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335565 with bad export cookie 12700211737639679135 [ 8751.371759] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8751.374753] LustreError: 289120:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8751.939287] Lustre: server umount lustre-MDT0001 complete [ 8760.418070] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8764.778871] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8770.211750] Lustre: server umount MGS complete [ 8782.004329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8782.653116] LustreError: 291193:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8782.676187] LustreError: 291193:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8782.691749] LustreError: 291206:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8782.788925] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8787.622262] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8787.941947] LustreError: 291194:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8792.034982] LustreError: 291193:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8797.155757] LustreError: 291194:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8797.276578] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8797.780593] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8802.001451] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8806.960988] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8810.107618] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8815.981210] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8816.241758] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8821.495439] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8827.188826] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8848.354330] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8848.372910] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8848.394717] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8848.408989] Lustre: Skipped 2 previous similar messages [ 8851.966827] Lustre: server umount lustre-OST0000 complete [ 8858.594669] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8858.610761] Lustre: Skipped 1 previous similar message [ 8858.614702] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8858.623485] Lustre: Skipped 1 previous similar message [ 8862.448086] Lustre: server umount lustre-MDT0000 complete [ 8863.715698] LustreError: 291188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8863.733715] LustreError: 291188:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8866.240227] LustreError: 293580:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335680 with bad export cookie 12700211737639681130 [ 8866.247896] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8866.263942] LustreError: 293580:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8866.798711] Lustre: server umount lustre-MDT0001 complete [ 8881.636820] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [ 8885.292825] Key type lgssc unregistered [ 8885.554169] LNet: 294780:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8885.566417] LNetError: 294780:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8885.583059] LNet: Removed LNI 192.168.202.134@tcp [ 8886.522036] Key type .llcrypt unregistered [ 8886.526836] Key type ._llcrypt unregistered [ 8909.625526] Key type ._llcrypt registered [ 8909.627650] Key type .llcrypt registered [ 8909.747447] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 8924.873334] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 8925.769761] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8925.886618] alg: No test for adler32 (adler32-zlib) [ 8926.935953] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [ 8927.151402] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [ 8928.824379] Key type lgssc registered [ 8930.127920] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8956.836239] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 8976.460914] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8976.496780] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8977.830389] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8977.866459] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8977.939632] Lustre: lustre-MDT0000: new disk, initializing [ 8978.032313] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8978.068920] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8983.447660] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 8994.102030] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8994.328247] Lustre: lustre-OST0000: new disk, initializing [ 8994.332840] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8994.335490] Lustre: Skipped 1 previous similar message [ 8994.339523] Lustre: 298767:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8994.414696] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8995.273904] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8995.285298] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8995.327053] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9000.596207] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 9802.751950] Lustre: server umount lustre-MDT0000 complete [ 9807.492973] LustreError: 297971:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336621 with bad export cookie 1064503577366530361 [ 9807.504948] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9817.474301] Lustre: server umount lustre-OST0000 complete [ 9845.295207] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [ 9857.828985] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [ 9895.918232] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9896.238402] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9896.293568] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9896.442371] Lustre: lustre-MDT0000: new disk, initializing [ 9896.509789] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9896.521968] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9900.638206] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 9912.279293] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9912.425755] Lustre: 303046:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9912.524522] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9912.533994] Lustre: Skipped 1 previous similar message [ 9912.644606] Lustre: lustre-MDT0001: new disk, initializing [ 9912.764805] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9912.818087] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9912.834273] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9917.104611] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 9924.480656] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9928.711986] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9936.783439] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9937.161451] Lustre: lustre-OST0000: new disk, initializing [ 9937.167514] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9937.174057] Lustre: 304790:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9937.310189] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9943.941866] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [ 9945.620414] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9945.625496] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9945.717578] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9952.062597] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9957.133075] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9957.511794] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9965.080176] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9965.400425] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9971.170535] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9971.179327] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9971.195185] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9971.205490] Lustre: Skipped 1 previous similar message [ 9971.222133] Lustre: Skipped 1 previous similar message [ 9974.860694] Lustre: server umount lustre-OST0000 complete [ 9981.420219] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9981.423588] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9981.440496] Lustre: Skipped 1 previous similar message [ 9981.463256] Lustre: Skipped 1 previous similar message [ 9986.469707] Lustre: server umount lustre-MDT0000 complete [ 9991.656814] LustreError: 304239:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9991.718562] LustreError: 304239:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 9992.224279] LustreError: 303038:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336806 with bad export cookie 1064503577369471194 [ 9992.231075] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9992.241745] LustreError: 303038:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9993.132651] Lustre: server umount lustre-MDT0001 complete [ 9999.328399] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [10002.040585] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 14:00:14 (1780336814) [10010.205109] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10010.714313] LustreError: 306956:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10010.862918] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10016.079475] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10016.231825] LustreError: 306957:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10020.331350] LustreError: 306956:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10025.451101] LustreError: 306957:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10025.900155] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10026.249694] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10031.468885] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10037.303127] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10040.490502] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10046.524957] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10047.117760] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10053.140402] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10058.441186] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10065.383555] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10065.538423] Lustre: lustre-OST0001: new disk, initializing [10065.541316] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [10065.546176] Lustre: 309462:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10065.616128] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10072.932990] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10073.199428] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [10073.204740] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [10073.262194] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10074.280780] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10074.294735] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [10075.373919] LustreError: 309824:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10075.400804] LustreError: 309824:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [10077.480460] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10077.506996] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [10081.714924] LustreError: 309824:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10081.726700] LustreError: 309824:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [10083.543372] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10083.714168] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10087.600754] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff91ca45b95000.ost_server_uuid 50 [10089.460919] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff91ca45b95000.ost_server_uuid in FULL state after 0 sec [10089.962147] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10089.974047] LustreError: 309813:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages [10093.587491] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff91ca45b95000.ost_server_uuid 50 [10095.022627] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff91ca45b95000.ost_server_uuid in FULL state after 0 sec [10097.285811] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [10112.486990] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10112.503989] LustreError: Skipped 1 previous similar message [10112.510863] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10112.542476] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10119.374787] Lustre: lustre-OST0001: Not available for connect from 192.168.202.34@tcp (stopping) [10119.382563] Lustre: Skipped 4 previous similar messages [10124.481248] Lustre: lustre-OST0001: Not available for connect from 192.168.202.34@tcp (stopping) [10124.498881] Lustre: Skipped 2 previous similar messages [10126.305158] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10126.402936] Lustre: server umount lustre-OST0001 complete [10129.603453] LustreError: 308552:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.202.34@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10132.450966] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10132.462164] LustreError: Skipped 1 previous similar message [10132.469129] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10132.493782] Lustre: Skipped 1 previous similar message [10132.506890] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10132.521809] Lustre: Skipped 2 previous similar messages [10138.241507] Lustre: server umount lustre-OST0000 complete [10144.234707] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10144.246357] LustreError: Skipped 1 previous similar message [10144.253627] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10144.273226] Lustre: Skipped 1 previous similar message [10148.710775] Lustre: server umount lustre-MDT0000 complete [10150.369312] LustreError: 306956:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10150.382971] LustreError: 306956:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [10152.449526] LustreError: 306937:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336966 with bad export cookie 1064503577369472118 [10152.466817] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10152.807782] Lustre: server umount lustre-MDT0001 complete [10165.213832] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [10168.433939] Key type lgssc unregistered [10168.749811] LNet: 311908:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10168.760415] LNetError: 311908:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [10169.832474] LNet: Removed LNI 192.168.202.134@tcp [10170.784693] Key type .llcrypt unregistered [10170.787777] Key type ._llcrypt unregistered [10200.028554] Key type ._llcrypt registered [10200.039715] Key type .llcrypt registered [10200.187528] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [10201.710883] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10201.790623] alg: No test for adler32 (adler32-zlib) [10202.900701] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [10203.191128] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [10204.880234] Key type lgssc registered [10206.221666] Lustre: Echo OBD driver; http://www.lustre.org/ [10214.556054] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10214.571751] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10215.956902] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10220.220842] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10226.155074] LustreError: 313313:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10226.165126] LustreError: 313313:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10226.514980] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10231.280521] LustreError: 313314:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10234.232231] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10234.790314] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10241.329286] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10251.283644] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10251.566233] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10257.139639] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10259.771415] LustreError: 314865:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10261.803366] LustreError: 314866:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10261.822212] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [10261.844761] LustreError: 314866:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10263.037621] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10267.127150] LustreError: 314866:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10267.175338] LustreError: 314866:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10272.066571] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10272.593495] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10277.905296] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [10281.188177] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10287.130328] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [10296.421990] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [10296.634133] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10400.737418] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10400.743849] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10400.749091] LustreError: Skipped 1 previous similar message [10400.753377] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10400.771133] Lustre: Skipped 1 previous similar message [10400.793178] Lustre: Skipped 1 previous similar message [10404.917785] Lustre: server umount lustre-OST0001 complete [10405.869494] LustreError: 315328:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10405.881227] LustreError: 315328:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [10411.024433] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10411.047417] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10414.064184] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10414.067878] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10414.094888] Lustre: Skipped 1 previous similar message [10419.175458] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10424.296667] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10424.323315] LustreError: 315328:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10424.327152] Lustre: Skipped 2 previous similar messages [10424.404412] LustreError: 315328:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [10425.312159] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10425.702243] Lustre: server umount lustre-OST0000 complete [10434.534876] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10434.542151] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10434.565342] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10444.256635] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10444.878876] Lustre: server umount lustre-MDT0000 complete [10448.873575] LustreError: 313293:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337263 with bad export cookie 4541217636014464359 [10448.874582] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10448.882213] LustreError: 313293:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10449.451508] Lustre: server umount lustre-MDT0001 complete [10460.662212] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [10463.413746] Key type lgssc unregistered [10463.669800] LNet: 317870:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10463.688549] LNetError: 317870:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [10464.743985] LNet: Removed LNI 192.168.202.134@tcp [10465.718079] Key type .llcrypt unregistered [10465.723263] Key type ._llcrypt unregistered [10512.054868] Key type ._llcrypt registered [10512.059427] Key type .llcrypt registered [10512.172548] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [10514.113054] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10514.231711] alg: No test for adler32 (adler32-zlib) [10515.343571] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [10515.559663] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [10517.217723] Key type lgssc registered [10518.463476] Lustre: Echo OBD driver; http://www.lustre.org/ [10529.153675] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10529.176627] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10530.697716] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10535.191996] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10540.011490] LustreError: 320162:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10540.029100] LustreError: 320162:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10544.486819] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10544.818429] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10549.628404] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10552.718789] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10560.188814] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10560.644801] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10567.155194] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10569.845524] LustreError: 321621:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10574.949797] LustreError: 322090:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10574.972509] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [10574.976478] LustreError: 322090:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10575.868398] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10576.178375] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10581.498785] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [10582.767156] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10592.963830] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10599.706574] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [10612.200233] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10612.211244] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10612.218350] Lustre: Skipped 1 previous similar message [10612.240269] Lustre: Skipped 3 previous similar messages [10617.321395] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10617.335521] Lustre: Skipped 3 previous similar messages [10618.489944] Lustre: server umount lustre-MDT0000 complete [10622.437730] LustreError: 320162:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10622.451971] LustreError: 320162:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [10622.783352] LustreError: 320141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337436 with bad export cookie 5521522116725075775 [10622.792328] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10622.797297] LustreError: 320141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10623.179464] Lustre: server umount lustre-MDT0001 complete [10638.133872] Lustre: server umount lustre-OST0000 complete [10652.184708] Lustre: server umount lustre-OST0001 complete [10672.635607] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [10686.610839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10687.359996] LustreError: 325343:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10687.486558] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10694.340700] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10697.704641] LustreError: 325344:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10697.717658] LustreError: 325344:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10703.313823] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10703.643612] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10708.295568] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10711.597950] Lustre: 326454:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10718.550493] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10725.356320] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10728.121506] LustreError: 326809:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10728.143744] LustreError: 326809:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10732.241140] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10736.064415] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10736.338843] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10736.347231] Lustre: Skipped 1 previous similar message [10741.751610] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10744.084785] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [10753.241916] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10757.233031] Lustre: 328291:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10762.212539] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10762.222732] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10762.236692] Lustre: Skipped 4 previous similar messages [10762.240760] Lustre: Skipped 1 previous similar message [10767.338623] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10767.348078] Lustre: Skipped 5 previous similar messages [10768.164576] Lustre: server umount lustre-MDT0000 complete [10772.185809] LustreError: 325323:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337586 with bad export cookie 5521522116725077476 [10772.196636] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10772.212916] LustreError: 325323:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10772.484962] Lustre: server umount lustre-MDT0001 complete [10786.481694] Lustre: server umount lustre-OST0000 complete [10788.833142] Lustre: 319423:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780337586/real 1780337586] req@ffff9ece77b04a80 x1866818995208192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780337602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [10788.878396] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10788.895370] Lustre: Skipped 1 previous similar message [10790.519467] Lustre: server umount lustre-OST0001 complete [10794.207384] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10795.685529] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10797.090948] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 14:13:30 (1780337610) [10820.037819] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [10831.016614] loop0: detected capacity change from 0 to 1099511627776 [10831.976378] SGI XFS with ACLs, security attributes, quota, no debug enabled [10831.989838] *** VALIDATE xfs *** [10832.026523] XFS (loop0): Mounting V5 Filesystem [10832.052889] XFS (loop0): Ending clean mount [10833.618957] loop1: detected capacity change from 0 to 18691697672192 [10952.641947] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [10962.028591] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [11002.172501] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11002.518634] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11002.571461] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11002.637793] Lustre: lustre-MDT0000: new disk, initializing [11002.765681] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11002.792580] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11008.933886] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11020.912311] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11021.018821] Lustre: 333376:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11021.078965] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11021.082788] Lustre: Skipped 1 previous similar message [11021.166996] Lustre: lustre-MDT0001: new disk, initializing [11021.308370] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11021.322462] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11025.919756] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11034.276211] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11038.036909] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11045.652075] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11045.945637] Lustre: lustre-OST0000: new disk, initializing [11045.948823] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11045.957543] Lustre: 335116:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11047.672741] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11047.680477] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11047.842062] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11053.429690] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11062.058047] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11067.074423] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11067.247668] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11072.698202] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11073.180217] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11078.631780] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11078.637666] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11078.651758] LustreError: Skipped 1 previous similar message [11078.652809] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11078.693076] Lustre: Skipped 1 previous similar message [11088.867729] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11088.872111] Lustre: Skipped 3 previous similar messages [11090.400176] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11090.608956] Lustre: server umount lustre-OST0000 complete [11098.085322] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11098.094130] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11109.345881] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11109.347185] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 4. Is it stuck? [11109.359511] Lustre: Skipped 7 previous similar messages [11109.667552] Lustre: server umount lustre-MDT0000 complete [11114.111558] LustreError: 333366:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337928 with bad export cookie 5521522116725079023 [11114.120761] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11114.566659] Lustre: server umount lustre-MDT0001 complete [11123.915366] XFS (loop0): Unmounting Filesystem [11128.971121] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 14:19:02 (1780337942) [11135.075782] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11135.526062] LustreError: 337530:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11135.542911] LustreError: 337530:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11135.590191] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11135.596622] Lustre: Skipped 2 previous similar messages [11140.133119] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11148.344696] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11152.184899] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11158.064911] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11162.682747] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11170.031559] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11177.996480] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11183.693086] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11194.342062] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11194.347633] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11194.353464] Lustre: Skipped 1 previous similar message [11194.359284] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11198.851236] Lustre: server umount lustre-OST0000 complete [11205.092773] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11208.833115] Lustre: server umount lustre-MDT0000 complete [11211.746695] LustreError: 338243:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11211.778668] LustreError: 338243:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11213.810097] LustreError: 337511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780338027 with bad export cookie 5521522116725079947 [11213.845853] LustreError: 337511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11213.870128] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11214.493669] Lustre: server umount lustre-MDT0001 complete [11227.980334] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [11231.493333] Key type lgssc unregistered [11231.820344] LNet: 340803:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11231.832908] LNetError: 340803:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [11231.870325] LNet: Removed LNI 192.168.202.134@tcp [11232.911181] Key type .llcrypt unregistered [11232.912681] Key type ._llcrypt unregistered [11266.378712] Key type ._llcrypt registered [11266.383987] Key type .llcrypt registered [11266.500791] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [11268.734070] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11268.779086] alg: No test for adler32 (adler32-zlib) [11270.136570] Lustre: Lustre: Build Version: 2.17.53_33_g3f95abe [11270.671679] LNet: Added LNI 192.168.202.134@tcp [8/256/0/180] [11272.522803] Key type lgssc registered [11274.141591] Lustre: Echo OBD driver; http://www.lustre.org/ [11284.549855] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11284.584589] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11286.459362] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11291.794971] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11296.740703] LustreError: 342359:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11296.763427] LustreError: 342359:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11301.865875] LustreError: 342360:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11302.729207] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11303.157724] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11308.183535] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11314.522142] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11318.708653] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11326.250087] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11326.613812] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11333.750898] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11339.888567] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11347.431962] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11347.455928] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11347.475909] Lustre: Skipped 1 previous similar message [11351.765202] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.34@tcp (stopping) [11354.039980] Lustre: server umount lustre-MDT0001 complete [11356.868545] LustreError: 342354:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.34@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11361.973808] LustreError: 342354:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.34@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11361.982091] LustreError: 342354:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11366.652925] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11366.857341] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11366.872808] Lustre: Found index 1 for lustre-MDT0001, updating log [11366.978815] Lustre: 342348:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11367.114258] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.34@tcp (not set up) [11367.128113] Lustre: Skipped 2 previous similar messages [11367.383579] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11372.433523] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11372.546043] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11377.190760] LustreError: 345617:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11377.209966] LustreError: 345617:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11377.223553] LustreError: 342351:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11377.300956] LustreError: 345620:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.134@tcp: cfg command failed: rc = -17 [11377.309725] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [11377.309725] [11679.447392] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.34@tcp (stopping) [11679.719852] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11679.736660] Lustre: Skipped 1 previous similar message [11679.740459] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11684.452221] Lustre: server umount lustre-MDT0001 complete [11684.542857] LustreError: 342356:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.34@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11684.563059] LustreError: 342356:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11694.776878] LustreError: 342356:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.34@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11694.801223] LustreError: 342356:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [11695.891670] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11696.058562] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11696.063397] Lustre: Found index 1 for lustre-MDT0001, updating log [11696.122711] Lustre: 342346:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11696.645577] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [11701.116930] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [11701.740766] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11705.856468] LustreError: 354115:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11705.870984] LustreError: 354115:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11705.891261] LustreError: 342351:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11705.899374] LustreError: 342351:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11706.021688] LustreError: 354118:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [11706.029560] LustreError: 354118:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [11706.042933] LustreError: 354118:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.134@tcp: cfg command failed: rc = -17 [11706.057119] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.134@tcp [11706.057119] [12008.937084] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12008.937634] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12008.964212] Lustre: Skipped 1 previous similar message [12008.986914] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12008.995766] Lustre: Skipped 3 previous similar messages [12014.073121] LustreError: 343072:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12014.089560] LustreError: 343072:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [12014.215846] Lustre: server umount lustre-MDT0001 complete [12024.004516] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12024.097949] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12024.101819] Lustre: Found index 1 for lustre-MDT0001, updating log [12024.160386] Lustre: 342349:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12024.296082] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [12024.304384] Lustre: Skipped 2 previous similar messages [12024.434720] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12027.861456] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [12029.935699] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12033.518470] LustreError: 362581:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12033.529798] LustreError: 362581:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12033.550646] LustreError: 342351:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12033.572113] LustreError: 342351:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12033.625219] LustreError: 362584:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12033.642261] LustreError: 362584:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.134@tcp: cfg command failed: rc = -114 [12033.660122] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12033.660122] [12351.971908] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12351.991265] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12352.010840] Lustre: Skipped 1 previous similar message [12352.016446] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12357.609226] LustreError: 352217:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12357.643330] LustreError: 352217:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [12358.715455] Lustre: server umount lustre-MDT0000 complete [12363.036426] LustreError: 345206:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339177 with bad export cookie 13370212414832209151 [12363.037858] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12363.045671] LustreError: 345206:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [12367.848058] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12367.855232] Lustre: Skipped 2 previous similar messages [12369.605554] Lustre: server umount lustre-MDT0001 complete [12374.141133] Lustre: server umount lustre-OST0000 complete [12385.724964] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [12398.012085] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [12445.086646] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 14:40:58 (1780339258) [12453.182323] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12453.617454] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12453.674914] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12453.797062] Lustre: lustre-MDT0000: new disk, initializing [12453.928664] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12454.000715] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12460.711322] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [12473.268634] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12473.416089] Lustre: 372977:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12473.478048] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12473.482115] Lustre: Skipped 1 previous similar message [12473.624852] Lustre: lustre-MDT0001: new disk, initializing [12473.833907] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12473.889873] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12473.902816] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12478.432663] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [12486.983325] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12491.026912] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12498.958486] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12499.361515] Lustre: lustre-OST0000: new disk, initializing [12499.371053] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12499.382416] Lustre: 374720:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [12499.504490] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12506.144446] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug -1 all [12506.298244] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12506.318584] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12506.445684] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12515.617925] Lustre: DEBUG MARKER: oleg234-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12525.027362] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12525.034510] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12525.055863] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12525.059851] Lustre: Skipped 5 previous similar messages [12526.504328] Lustre: server umount lustre-MDT0000 complete [12527.087565] LustreError: 374019:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12527.117813] LustreError: 374019:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [12530.856587] LustreError: 372969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339344 with bad export cookie 13370212414832211104 [12530.881349] LustreError: 372969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [12530.882897] LustreError: MGC192.168.202.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12531.390404] Lustre: server umount lustre-MDT0001 complete [12546.077271] Lustre: server umount lustre-OST0000 complete [12578.422283] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_hostid [12590.644080] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing load_modules_local [12628.849572] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 12382 sec ========= 14:44:01 (1780339441) [12630.684647] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 14:44:03 (1780339443) === [12634.896412] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 14:44:07 (1780339447) === [12682.332110] Lustre: DEBUG MARKER: oleg234-server.virtnet: executing unload_modules_local [12685.937980] Key type lgssc unregistered [12686.351609] LNet: 380925:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12686.356351] LNetError: 380925:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [12687.405622] LNet: Removed LNI 192.168.202.134@tcp [12688.467110] Key type .llcrypt unregistered [12688.469205] Key type ._llcrypt unregistered