[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 476616790 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b30-0x000f5b3f] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5950 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1BB7 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1A53 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1AC7 000090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1B57 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1B8F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1a53-0xbffe1ac6] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a52] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1ac7-0xbffe1b56] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1b57-0xbffe1b8e] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1b8f-0xbffe1bb6] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.003372] x2apic enabled [ 0.004010] Switched APIC routing to physical x2apic. [ 0.005015] kvm-guest: setup PV IPIs [ 0.007939] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008023] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.010008] pid_max: default: 32768 minimum: 301 [ 0.012108] LSM: Security Framework initializing [ 0.013051] Yama: becoming mindful. [ 0.015031] SELinux: Initializing. [ 0.016006] *** VALIDATE selinux *** [ 0.024364] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.028671] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.029151] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030124] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.032049] *** VALIDATE tmpfs *** [ 0.033452] *** VALIDATE proc *** [ 0.034230] *** VALIDATE cgroup *** [ 0.035010] *** VALIDATE cgroup2 *** [ 0.036311] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037183] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.038008] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039028] Spectre V2 : User space: Vulnerable [ 0.040009] Speculative Store Bypass: Vulnerable [ 0.043340] debug: unmapping init [mem 0xffffffff87c59000-0xffffffff87c60fff] [ 0.045150] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.046727] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047025] ... version: 2 [ 0.048013] ... bit width: 48 [ 0.049012] ... generic registers: 4 [ 0.050013] ... value mask: 0000ffffffffffff [ 0.051015] ... max period: 00007fffffffffff [ 0.052015] ... fixed-purpose events: 3 [ 0.053013] ... event mask: 000000070000000f [ 0.054327] rcu: Hierarchical SRCU implementation. [ 0.056541] smp: Bringing up secondary CPUs ... [ 0.057582] x86: Booting SMP configuration: [ 0.058030] .... node #0, CPUs: #1 #2 #3 [ 0.062046] smp: Brought up 1 node, 4 CPUs [ 0.064013] smpboot: Max logical packages: 1 [ 0.065013] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.147065] node 0 deferred pages initialised in 81ms [ 0.151036] devtmpfs: initialized [ 0.152264] x86/mm: Memory block size: 128MB [ 0.154728] gcov: version magic: 0x41383552 [ 0.156172] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.157075] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.158246] pinctrl core: initialized pinctrl subsystem [ 0.159203] [ 0.159793] ************************************************************* [ 0.160014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.161015] ** ** [ 0.162015] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.163013] ** ** [ 0.164009] ** This means that this kernel is built to expose internal ** [ 0.165013] ** IOMMU data structures, which may compromise security on ** [ 0.166012] ** your system. ** [ 0.167015] ** ** [ 0.168014] ** If you see this message and you are not debugging the ** [ 0.169013] ** kernel, report this immediately to your vendor! ** [ 0.170012] ** ** [ 0.171016] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.172013] ************************************************************* [ 0.173663] NET: Registered protocol family 16 [ 0.174409] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.175065] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.176067] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.178174] cpuidle: using governor menu [ 0.179611] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.182432] PCI: Using configuration type 1 for base access [ 0.184127] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.193107] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.194025] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.196186] cryptd: max_cpu_qlen set to 1000 [ 0.198278] ACPI: Added _OSI(Module Device) [ 0.199017] ACPI: Added _OSI(Processor Device) [ 0.200013] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.201011] ACPI: Added _OSI(Processor Aggregator Device) [ 0.204457] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.206512] ACPI: Interpreter enabled [ 0.207056] ACPI: PM: (supports S0 S3 S4 S5) [ 0.208012] ACPI: Using IOAPIC for interrupt routing [ 0.209122] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.210390] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.219013] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.220040] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.221021] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.222079] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.224181] acpiphp: Slot [2] registered [ 0.225133] acpiphp: Slot [3] registered [ 0.226090] acpiphp: Slot [4] registered [ 0.227101] acpiphp: Slot [5] registered [ 0.228135] acpiphp: Slot [6] registered [ 0.229118] acpiphp: Slot [7] registered [ 0.230163] acpiphp: Slot [8] registered [ 0.231091] acpiphp: Slot [9] registered [ 0.232134] acpiphp: Slot [10] registered [ 0.233104] acpiphp: Slot [11] registered [ 0.234115] acpiphp: Slot [12] registered [ 0.235089] acpiphp: Slot [13] registered [ 0.236146] acpiphp: Slot [14] registered [ 0.237099] acpiphp: Slot [15] registered [ 0.238094] acpiphp: Slot [16] registered [ 0.239080] acpiphp: Slot [17] registered [ 0.240073] acpiphp: Slot [18] registered [ 0.241102] acpiphp: Slot [19] registered [ 0.242128] acpiphp: Slot [20] registered [ 0.243093] acpiphp: Slot [21] registered [ 0.244099] acpiphp: Slot [22] registered [ 0.245097] acpiphp: Slot [23] registered [ 0.246104] acpiphp: Slot [24] registered [ 0.247097] acpiphp: Slot [25] registered [ 0.248097] acpiphp: Slot [26] registered [ 0.249088] acpiphp: Slot [27] registered [ 0.250072] acpiphp: Slot [28] registered [ 0.251068] acpiphp: Slot [29] registered [ 0.252067] acpiphp: Slot [30] registered [ 0.253074] acpiphp: Slot [31] registered [ 0.254000] PCI host bridge to bus 0000:00 [ 0.254000] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.255029] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.258024] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.260024] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.263023] pci_bus 0000:00: root bus resource [mem 0x180000000-0x1ffffffff window] [ 0.265023] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.267174] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.271252] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.275537] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.286013] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.289726] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.292016] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.294014] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.296018] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.298399] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.301802] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.304057] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.306614] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.310819] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.321016] pci 0000:00:02.0: reg 0x20: [mem 0xfebe4000-0xfebe7fff 64bit pref] [ 0.327015] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.332031] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.342017] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.350018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.367015] pci 0000:00:05.0: reg 0x20: [mem 0xfebe8000-0xfebebfff 64bit pref] [ 0.377201] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.382014] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.388014] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.401027] pci 0000:00:06.0: reg 0x20: [mem 0xfebec000-0xfebeffff 64bit pref] [ 0.411782] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.418017] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.427015] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.441017] pci 0000:00:07.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref] [ 0.451152] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.459018] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.465019] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.484017] pci 0000:00:08.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.494073] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.499015] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.505020] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.518019] pci 0000:00:09.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.526222] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.532015] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.537016] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.553026] pci 0000:00:0a.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.564449] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.566390] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.568379] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.571385] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.573273] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.577127] iommu: Default domain type: Passthrough [ 0.578000] SCSI subsystem initialized [ 0.578115] ACPI: bus type USB registered [ 0.579109] usbcore: registered new interface driver usbfs [ 0.581083] usbcore: registered new interface driver hub [ 0.582117] usbcore: registered new device driver usb [ 0.584151] pps_core: LinuxPPS API ver. 1 registered [ 0.586012] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.589061] PTP clock support registered [ 0.595128] EDAC MC: Ver: 3.0.0 [ 0.597121] PCI: Using ACPI for IRQ routing [ 0.599021] NetLabel: Initializing [ 0.601010] NetLabel: domain hash size = 128 [ 0.602009] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.604112] NetLabel: unlabeled traffic allowed by default [ 0.607043] vgaarb: loaded [ 0.608306] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.611018] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.616016] clocksource: Switched to clocksource kvm-clock [ 0.719562] VFS: Disk quotas dquot_6.6.0 [ 0.721155] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.723702] *** VALIDATE ramfs *** [ 0.725020] *** VALIDATE hugetlbfs *** [ 0.726505] pnp: PnP ACPI init [ 0.728770] pnp: PnP ACPI: found 6 devices [ 0.754319] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.757409] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.759689] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.761781] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.764394] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.766960] pci_bus 0000:00: resource 8 [mem 0x180000000-0x1ffffffff window] [ 0.769447] NET: Registered protocol family 2 [ 0.771930] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.776675] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.780446] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.785879] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.789476] TCP: Hash tables configured (established 65536 bind 65536) [ 0.792239] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.795164] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.797495] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.800538] NET: Registered protocol family 1 [ 0.803232] RPC: Registered named UNIX socket transport module. [ 0.805105] RPC: Registered udp transport module. [ 0.806769] RPC: Registered tcp transport module. [ 0.808496] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.810564] NET: Registered protocol family 44 [ 0.812721] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.815933] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.817811] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.819819] PCI: CLS 0 bytes, default 64 [ 0.821442] Unpacking initramfs... [ 2.206346] debug: unmapping init [mem 0xffff908ebcc54000-0xffff908ebffbffff] [ 2.210463] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.213042] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.216152] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.718109] Initialise system trusted keyrings [ 2.719767] Key type blacklist registered [ 2.721491] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.730057] zbud: loaded [ 2.732930] *** VALIDATE nfs *** [ 2.734051] *** VALIDATE nfs4 *** [ 2.735314] pstore: using deflate compression [ 2.738083] Platform Keyring initialized [ 2.827108] NET: Registered protocol family 38 [ 2.828848] Key type asymmetric registered [ 2.830298] Asymmetric key parser 'x509' registered [ 2.831825] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.835277] io scheduler mq-deadline registered [ 2.836749] io scheduler kyber registered [ 2.838283] io scheduler bfq registered [ 2.840526] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.843341] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.846827] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.849939] ACPI: Power Button [PWRF] [ 2.938483] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.027052] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.204788] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.293130] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.470433] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.502824] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.533580] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.538597] Non-volatile memory driver v1.3 [ 3.539959] Linux agpgart interface v0.103 [ 3.570024] virtio_blk virtio1: [vda] 133848 512-byte logical blocks (68.5 MB/65.4 MiB) [ 3.572931] vda: detected capacity change from 0 to 68530176 [ 3.586358] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.589188] vdb: detected capacity change from 0 to 1073741824 [ 3.606591] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.609335] vdc: detected capacity change from 0 to 2621440000 [ 3.624616] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.627751] vdd: detected capacity change from 0 to 2621440000 [ 3.645419] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.648726] vde: detected capacity change from 0 to 4294967296 [ 3.663768] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.666761] vdf: detected capacity change from 0 to 4294967296 [ 3.672365] libphy: Fixed MDIO Bus: probed [ 3.680671] usbcore: registered new interface driver usbserial_generic [ 3.682396] usbserial: USB Serial support registered for generic [ 3.684320] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.688278] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.689962] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.692209] mousedev: PS/2 mouse device common for all mice [ 3.694882] rtc_cmos 00:05: RTC can wake from S4 [ 3.695878] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.700984] rtc_cmos 00:05: registered as rtc0 [ 3.704795] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.704805] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.707674] intel_pstate: CPU model not supported [ 3.713662] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.714514] hid: raw HID events driver (C) Jiri Kosina [ 3.720657] usbcore: registered new interface driver usbhid [ 3.722463] usbhid: USB HID core driver [ 3.724169] drop_monitor: Initializing network drop monitor service [ 3.726640] Initializing XFRM netlink socket [ 3.728742] NET: Registered protocol family 10 [ 3.731587] Segment Routing with IPv6 [ 3.733632] NET: Registered protocol family 17 [ 3.735812] mpls_gso: MPLS GSO support [ 3.741225] RAS: Correctable Errors collector initialized. [ 3.743457] AVX version of gcm_enc/dec engaged. [ 3.745727] AES CTR mode by8 optimization enabled [ 3.810434] sched_clock: Marking stable (3810402380, 0)->(4790785180, -980382800) [ 3.813969] registered taskstats version 1 [ 3.816217] Loading compiled-in X.509 certificates [ 3.818228] zswap: loaded using pool lzo/zbud [ 3.842987] Key type big_key registered [ 3.855630] Key type encrypted registered [ 3.857330] ima: No TPM chip found, activating TPM-bypass! [ 3.859505] ima: Allocated hash algorithm: sha1 [ 3.861679] ima: No architecture policies found [ 3.863458] evm: Initialising EVM extended attributes: [ 3.866384] evm: security.selinux [ 3.867632] evm: security.ima [ 3.868747] evm: security.capability [ 3.870202] evm: HMAC attrs: 0x1 [ 3.872803] rtc_cmos 00:05: setting system clock to 2025-11-17 02:14:57 UTC (1763345697) [ 3.878990] debug: unmapping init [mem 0xffffffff88c03000-0xffffffff88dfffff] [ 3.882278] debug: unmapping init [mem 0xffffffff87982000-0xffffffff87c58fff] [ 3.892091] Write protecting the kernel read-only data: 28672k [ 3.895645] debug: unmapping init [mem 0xffffffff86003000-0xffffffff861fffff] [ 3.898537] debug: unmapping init [mem 0xffffffff86914000-0xffffffff869fffff] [ 3.939447] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.947422] systemd[1]: Detected virtualization kvm. [ 3.949424] systemd[1]: Detected architecture x86-64. [ 3.954714] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.983824] systemd[1]: No hostname configured. [ 3.985643] systemd[1]: Set hostname to . [ 3.987771] random: systemd: uninitialized urandom read (16 bytes read) [ 3.990086] systemd[1]: Initializing machine ID from random generator. [ 4.030724] random: ln: uninitialized urandom read (6 bytes read) [ 4.125234] random: systemd: uninitialized urandom read (16 bytes read) [ 4.128405] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.136845] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 4.141130] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ OK ] Listening on udev Kernel Socket. [ OK ] Started Memstrack Anylazing Service. [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Initrd Root Device. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Slices. [ OK ] Reached target Local File Systems. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. Starting Create Volatile Files and Directories... [ OK ] Reached target Timers. Starting Apply Kernel Variables... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.749837] device-mapper: uevent: version 1.0.3 [ 4.752103] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.402419] random: fast init done [ 5.408990] virtio_net virtio0 ens2: renamed from eth0 [ 5.442624] scsi host0: ata_piix [ 5.462071] scsi host1: ata_piix [ 5.475152] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.477410] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.049813] dracut-initqueue[584]: RTNETLINK answers: File exists [ 10.376381] random: crng init done [ 10.377803] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.684048] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.813339] printk: systemd: 26 output lines suppressed due to ratelimiting [ 12.057370] SELinux: Disabled at runtime. [ 12.111739] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.120491] systemd[1]: Detected virtualization kvm. [ 12.122258] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.654920] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.657829] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.662042] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.667330] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.671112] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.679198] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.689871] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Listening on udev Kernel Socket. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Mounting POSIX Message Queue File System... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-getty.slice. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Created slice system-sshd\x2dkeygen.slice. Activating swap /dev/disk/by-label/SWAP... Starting Apply Kernel Variables... [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Huge Pages File System... [ OK ] Reached target Paths. Starting Remount Root and Kernel File Systems... [ 12.848673] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ OK ] Started udev Coldplug all Devices. [ 13.101200] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 13.436979] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.443610] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.566181] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.593246] EDAC sbridge: Ver: 1.1.2 [ 15.105962] Key type dns_resolver registered [ 15.408867] NFS: Registering the id_resolver key type [ 15.410543] Key type id_resolver registered [ 15.411779] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... Starting Restore /run/initramfs on shutdown... [ OK ] Reached target sshd-keygen.target. [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started dnf makecache --timer. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Authorization Manager. [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg425-server login: [ 41.514211] libcfs: loading out-of-tree module taints kernel. [ 41.526119] Key type ._llcrypt registered [ 41.527757] Key type .llcrypt registered [ 41.573541] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 53.371849] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 54.584685] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 54.596533] alg: No test for adler32 (adler32-zlib) [ 55.846284] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 56.616631] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 58.359169] Key type lgssc registered [ 59.973486] Lustre: Echo OBD driver; http://www.lustre.org/ [ 61.415018] hrtimer: interrupt took 3026476 ns [ 74.710359] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 75.701191] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 82.831893] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 89.774149] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 96.883559] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 110.509760] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 123.357423] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 123.407060] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 123.447250] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 124.750913] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 124.814275] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 124.897781] Lustre: lustre-MDT0000: new disk, initializing [ 125.061031] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 125.086699] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 128.988844] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 141.527420] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 141.585535] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 141.655674] Lustre: 6485:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 141.696583] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 141.701656] Lustre: Skipped 1 previous similar message [ 141.781958] Lustre: lustre-MDT0001: new disk, initializing [ 141.871371] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 141.924038] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 141.933150] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 145.595810] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 150.400482] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 158.898496] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 158.954791] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 159.126877] Lustre: lustre-OST0000: new disk, initializing [ 159.136122] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 159.145117] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 159.192039] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 164.554684] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 165.917546] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 165.922477] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 169.465264] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 177.491750] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 177.552646] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 177.625864] Lustre: lustre-OST0001: new disk, initializing [ 177.628462] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 177.710947] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 183.910783] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 186.917648] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 186.936669] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 191.982776] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 195.119892] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 205.863160] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 215.681060] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing check_logdir /tmp/testlogs/ [ 218.939239] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing yml_node [ 222.656072] Lustre: DEBUG MARKER: Client: 2.16.61.45 [ 225.042199] Lustre: DEBUG MARKER: MDS: 2.16.61.45 [ 227.632668] Lustre: DEBUG MARKER: OSS: 2.16.61.45 [ 229.621939] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Sun Nov 16 21:18:41 EST 2025 [ 246.060081] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 247.751756] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 263.647627] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 263.653238] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 267.758569] LustreError: 12193:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 267.831748] Lustre: server umount lustre-MDT0000 complete [ 270.815933] LustreError: 6479:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345964 with bad export cookie 15486845585601677037 [ 270.816053] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 270.824466] LustreError: 6479:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 273.888371] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 273.891824] LustreError: 10212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 273.893729] Lustre: Skipped 3 previous similar messages [ 273.901135] LustreError: 10212:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 273.916081] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 273.917902] Lustre: Skipped 3 previous similar messages [ 275.937777] LustreError: 10213:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 275.937849] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 275.946412] LustreError: 10213:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 275.948958] Lustre: Skipped 1 previous similar message [ 281.057290] LustreError: 10213:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 281.058093] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 281.077147] Lustre: Skipped 1 previous similar message [ 281.078332] LustreError: 10213:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 285.152565] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 285.228245] LustreError: 12395:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 285.230094] LustreError: 12395:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 285.333925] Lustre: server umount lustre-MDT0001 complete [ 288.311129] LustreError: 12598:0:(obd_class.h:479:obd_check_dev()) Device 20 not setup [ 288.323967] LustreError: 12598:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 288.380565] Lustre: server umount lustre-OST0000 complete [ 291.220168] LustreError: 12798:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 291.226567] LustreError: 12798:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 291.337941] Lustre: server umount lustre-OST0001 complete [ 296.511564] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 304.613627] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 312.741189] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 318.484168] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 323.311877] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 328.541971] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 334.450913] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 334.517098] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 334.753128] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 334.789649] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 334.845216] Lustre: lustre-MDT0000: new disk, initializing [ 334.953900] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 335.000420] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 338.533315] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 347.697853] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 347.747228] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 347.809863] Lustre: 14982:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 347.856861] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 347.860200] Lustre: Skipped 1 previous similar message [ 347.950626] Lustre: lustre-MDT0001: new disk, initializing [ 348.044933] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 348.080259] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 348.100646] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 351.757713] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 358.199676] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 361.579744] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 367.545422] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 367.614737] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 367.836987] Lustre: lustre-OST0000: new disk, initializing [ 367.842458] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 367.920690] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 369.579036] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 369.594347] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 369.689855] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 373.352291] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 380.009689] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 383.387476] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 383.589859] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 387.385239] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 387.650542] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 390.119487] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 390.124865] Lustre: Skipped 1 previous similar message [ 390.128298] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 390.131812] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 390.138567] LustreError: Skipped 1 previous similar message [ 395.524449] LustreError: 17924:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 395.534538] LustreError: 17924:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 395.693665] Lustre: server umount lustre-OST0000 complete [ 400.354410] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 400.365643] Lustre: Skipped 1 previous similar message [ 405.662991] LustreError: 18126:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 405.676788] LustreError: 18126:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 405.825875] Lustre: server umount lustre-MDT0000 complete [ 408.988637] LustreError: 18127:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346102 with bad export cookie 15486845585601678570 [ 408.995441] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 409.000706] LustreError: 18127:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 409.014945] LustreError: 3628:0:(import.c:716:ptlrpc_connect_import_locked()) already connecting [ 409.275234] Lustre: server umount lustre-MDT0001 complete [ 414.135949] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 21:21:46 (1763346106) [ 419.881132] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 420.269518] LustreError: 18854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 420.351442] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 423.629330] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 425.443237] LustreError: 18854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 430.949128] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 434.941745] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 439.924290] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 443.536474] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 449.776203] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 454.983822] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 459.770534] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 468.567274] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 475.106374] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 475.117116] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 475.119827] Lustre: Skipped 2 previous similar messages [ 475.140748] Lustre: Skipped 9 previous similar messages [ 480.062248] LustreError: 21154:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 480.071631] LustreError: 21154:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 480.230167] LustreError: 19566:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 480.262325] LustreError: 19566:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 480.317150] Lustre: server umount lustre-MDT0000 complete [ 484.094831] LustreError: 18834:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346177 with bad export cookie 15486845585601679452 [ 484.108101] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 484.110340] LustreError: 18834:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 484.473500] Lustre: server umount lustre-MDT0001 complete [ 497.638237] Lustre: server umount lustre-OST0000 complete [ 517.094892] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 528.295469] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 528.885592] LustreError: 22883:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 529.019671] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 529.040282] Lustre: Skipped 2 previous similar messages [ 532.692936] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 541.246983] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 546.003781] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 548.427508] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 553.888900] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 559.691902] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 569.060266] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 569.116629] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 569.220668] Lustre: lustre-OST0001: new disk, initializing [ 569.227614] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 570.488056] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 570.507307] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 570.618024] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 576.164122] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 585.739670] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 588.797296] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 606.689506] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 606.696260] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 606.705282] Lustre: Skipped 4 previous similar messages [ 606.714844] Lustre: Skipped 2 previous similar messages [ 610.622838] LustreError: 26365:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 610.633207] LustreError: 26365:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 610.748215] Lustre: server umount lustre-MDT0000 complete [ 611.810972] LustreError: 22882:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 611.819266] LustreError: 22882:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 613.917518] LustreError: 22862:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346307 with bad export cookie 15486845585601680299 [ 613.924230] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 613.925352] LustreError: 22862:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 614.266671] Lustre: server umount lustre-MDT0001 complete [ 628.263874] Lustre: server umount lustre-OST0000 complete [ 640.648454] Lustre: server umount lustre-OST0001 complete [ 654.084896] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 663.668227] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 664.267418] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 664.280036] Lustre: Skipped 3 previous similar messages [ 668.629747] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 676.963925] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 680.986232] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 683.393139] Lustre: 29261:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 689.269711] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 695.650747] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 701.998485] LustreError: 29615:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 702.037801] LustreError: 29615:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 705.424520] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 711.729267] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 718.844148] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 722.229528] Lustre: 31117:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 733.665585] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 733.684607] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 733.712481] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 738.685878] LustreError: 31321:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 738.690028] LustreError: 31321:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 738.790408] Lustre: server umount lustre-MDT0000 complete [ 741.918634] LustreError: 31119:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346435 with bad export cookie 15486845585601681594 [ 741.933129] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 741.936748] LustreError: 31119:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 742.286903] Lustre: server umount lustre-MDT0001 complete [ 756.169617] Lustre: server umount lustre-OST0000 complete [ 769.931395] Lustre: server umount lustre-OST0001 complete [ 777.744579] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 21:27:49 (1763346469) [ 802.648438] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 811.438943] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 815.292395] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 824.409285] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 828.848357] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 831.821352] Lustre: 35019:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 838.617332] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 844.573601] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 850.280420] LustreError: 35378:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 850.293760] LustreError: 35378:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 852.153430] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 858.329469] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 865.865989] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 869.150688] Lustre: 36874:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 881.120056] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 881.123095] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 881.147146] Lustre: Skipped 3 previous similar messages [ 881.156142] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 881.162395] Lustre: Skipped 4 previous similar messages [ 884.367828] LustreError: 37027:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 884.369986] LustreError: 37027:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 884.487875] Lustre: server umount lustre-MDT0000 complete [ 888.198639] LustreError: 35022:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346581 with bad export cookie 15486845585601682700 [ 888.211302] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 888.223301] LustreError: 35022:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 888.485443] Lustre: server umount lustre-MDT0001 complete [ 903.746313] Lustre: server umount lustre-OST0000 complete [ 918.141503] Lustre: server umount lustre-OST0001 complete [ 926.841724] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 21:30:18 (1763346618) [ 939.839670] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 949.589995] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 950.216447] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 950.221881] Lustre: Skipped 7 previous similar messages [ 954.779757] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 963.404222] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 968.607129] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 972.381043] Lustre: 40120:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 980.996669] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 987.794951] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 995.645099] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1000.365066] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1006.228968] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1008.638459] Lustre: 41978:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1014.560436] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1014.563946] Lustre: Skipped 1 previous similar message [ 1020.391590] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1020.395570] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1020.413372] Lustre: Skipped 3 previous similar messages [ 1023.152603] Lustre: server umount lustre-MDT0000 complete [ 1026.488327] LustreError: 38983:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346720 with bad export cookie 15486845585601683806 [ 1026.500645] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1026.500872] LustreError: 38983:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1032.907804] Lustre: server umount lustre-MDT0001 complete [ 1040.449582] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1056.611524] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1061.809503] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1064.493420] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1068.417721] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1070.067073] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1070.070108] Lustre: Skipped 1 previous similar message [ 1073.734573] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1075.601601] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1079.005443] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1080.721551] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1085.415566] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1090.927353] Lustre: server umount lustre-MDT0000 complete [ 1094.528858] LustreError: 38984:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346788 with bad export cookie 15486845585601684996 [ 1094.534781] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1094.542951] LustreError: 38984:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 1094.827758] Lustre: server umount lustre-MDT0001 complete [ 1108.781020] Lustre: server umount lustre-OST0000 complete [ 1111.777964] Lustre: 3628:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763346789/real 1763346789] req@ffff908f11880e00 x1849002033572224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1763346805 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1112.213498] Lustre: server umount lustre-OST0001 complete [ 1121.891743] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 21:33:33 (1763346813) [ 1137.362592] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1145.797154] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1146.159405] LustreError: 46348:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1146.185422] LustreError: 46348:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 23 previous similar messages [ 1149.656896] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1156.696789] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1160.546118] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1163.287524] Lustre: 47467:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1169.309488] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1174.212473] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1180.778516] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1185.856045] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1193.151547] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1202.239265] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1218.017974] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1218.048428] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1218.064259] Lustre: Skipped 11 previous similar messages [ 1218.085804] Lustre: Skipped 27 previous similar messages [ 1221.579524] LustreError: 49541:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 1221.581863] LustreError: 49541:0:(obd_class.h:479:obd_check_dev()) Skipped 67 previous similar messages [ 1221.687919] Lustre: server umount lustre-MDT0000 complete [ 1225.317821] LustreError: 46328:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763346918 with bad export cookie 15486845585601685780 [ 1225.323839] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1225.549751] Lustre: server umount lustre-MDT0001 complete [ 1238.643268] Lustre: server umount lustre-OST0000 complete [ 1251.678465] Lustre: server umount lustre-OST0001 complete [ 1261.197945] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 21:35:53 (1763346953) [ 1263.775486] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1265.441960] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 21:35:57 (1763346957) [ 1274.612647] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 1281.999751] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1290.732765] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1296.137547] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1302.832699] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1302.901451] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1303.167484] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1303.225519] Lustre: lustre-MDT0000: new disk, initializing [ 1303.373733] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1306.869214] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1312.589861] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1318.521660] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1318.575276] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1318.764715] Lustre: lustre-OST0000: new disk, initializing [ 1318.767878] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1318.770902] Lustre: Skipped 1 previous similar message [ 1320.465800] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1320.480857] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1320.511902] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1323.529854] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1330.012651] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1332.288784] Lustre: DEBUG MARKER: create test files [ 1356.256363] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1360.769529] Lustre: server umount lustre-OST0000 complete [ 1364.068353] Lustre: server umount lustre-MDT0000 complete [ 1374.995107] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 1377.675306] Key type lgssc unregistered [ 1377.918392] LNet: 54885:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1377.926976] LNetError: 54885:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1378.981918] LNet: Removed LNI 192.168.204.125@tcp [ 1379.873210] Key type .llcrypt unregistered [ 1379.874613] Key type ._llcrypt unregistered [ 1404.969276] Key type ._llcrypt registered [ 1404.971285] Key type .llcrypt registered [ 1405.140154] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1406.112644] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1406.232315] alg: No test for adler32 (adler32-zlib) [ 1407.264979] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 1407.513276] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 1409.183184] Key type lgssc registered [ 1410.232694] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1416.604652] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1416.632678] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1418.006919] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1421.002227] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1426.063640] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1433.598238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1434.064446] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1440.673530] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1443.309611] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1443.450565] Lustre: 57488:0:(osd_internal.h:1472:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1443.454771] Lustre: 57488:0:(osd_handler.c:2082:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1443.476937] Lustre: 57488:0:(osd_handler.c:2089:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1443.480389] Lustre: 57488:0:(osd_handler.c:2099:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1443.513703] Lustre: 57488:0:(osd_handler.c:2106:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1443.521859] Lustre: 57488:0:(osd_handler.c:2113:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1446.103963] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1451.106480] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1456.338605] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1489.376973] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1489.391587] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1493.843182] LustreError: 58260:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1493.941902] Lustre: server umount lustre-OST0000 complete [ 1497.126331] LustreError: 58462:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [ 1497.131480] LustreError: 58462:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1497.281742] Lustre: server umount lustre-MDT0000 complete [ 1506.307463] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 1508.132868] Key type lgssc unregistered [ 1508.345646] LNet: 58993:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1508.355503] LNetError: 58993:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1508.370393] LNet: Removed LNI 192.168.204.125@tcp [ 1508.996866] Key type .llcrypt unregistered [ 1508.998710] Key type ._llcrypt unregistered [ 1532.351805] Key type ._llcrypt registered [ 1532.353512] Key type .llcrypt registered [ 1532.422582] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1532.941116] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1533.003248] alg: No test for adler32 (adler32-zlib) [ 1533.954258] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 1534.121454] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 1535.751278] Key type lgssc registered [ 1536.716729] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1542.237627] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1542.257792] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1543.633837] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1546.608726] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1551.446512] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1557.196187] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1557.419194] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1561.246531] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1565.498463] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1568.688550] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1568.753768] Lustre: 61676:0:(osd_internal.h:1472:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1568.759171] Lustre: 61676:0:(osd_handler.c:2082:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1568.761980] Lustre: 61676:0:(osd_handler.c:2089:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1568.766912] Lustre: 61676:0:(osd_handler.c:2099:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1568.771205] Lustre: 61676:0:(osd_handler.c:2106:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1568.775968] Lustre: 61676:0:(osd_handler.c:2113:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1575.169636] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1584.097796] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1584.099432] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1584.111222] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1587.971173] LustreError: 62370:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1588.093657] Lustre: server umount lustre-OST0000 complete [ 1591.094112] LustreError: 62572:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [ 1591.097655] LustreError: 62572:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1591.218650] Lustre: server umount lustre-MDT0000 complete [ 1598.067923] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 1599.900258] Key type lgssc unregistered [ 1600.076274] LNet: 63105:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1600.082076] LNetError: 63105:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1600.092563] LNet: Removed LNI 192.168.204.125@tcp [ 1600.584146] Key type .llcrypt unregistered [ 1600.586122] Key type ._llcrypt unregistered [ 1612.127132] Key type ._llcrypt registered [ 1612.128658] Key type .llcrypt registered [ 1612.196411] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 1623.799515] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1624.362889] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1624.401929] alg: No test for adler32 (adler32-zlib) [ 1625.377982] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 1625.528352] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 1627.151181] Key type lgssc registered [ 1627.900114] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1634.496990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1639.563108] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1644.886340] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1649.853791] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1655.548164] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1655.598847] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1655.611826] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1656.795545] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1656.825503] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1656.887841] Lustre: lustre-MDT0000: new disk, initializing [ 1656.961527] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1656.987539] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1659.796975] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1668.371696] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1668.428974] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1668.532830] Lustre: 66211:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1668.582494] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1668.584718] Lustre: Skipped 1 previous similar message [ 1668.663427] Lustre: lustre-MDT0001: new disk, initializing [ 1668.759853] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1668.811040] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1668.818666] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1671.451830] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1677.015433] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1679.812817] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1684.489974] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1684.548396] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1684.746172] Lustre: lustre-OST0000: new disk, initializing [ 1684.751856] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1684.818578] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1688.756839] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1694.586852] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1694.759974] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1694.769938] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1694.884316] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1698.004684] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1698.172530] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1701.407038] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1701.630923] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1704.929863] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1704.939434] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1704.942387] Lustre: Skipped 1 previous similar message [ 1709.240281] LustreError: 69151:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1709.310085] Lustre: server umount lustre-OST0000 complete [ 1714.658083] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1714.662494] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1714.668614] Lustre: Skipped 1 previous similar message [ 1714.672294] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1717.932225] LustreError: 69354:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1717.935477] LustreError: 69354:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1718.084335] Lustre: server umount lustre-MDT0000 complete [ 1720.344595] LustreError: 69355:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763347413 with bad export cookie 5393854664336701978 [ 1720.349331] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1720.358759] LustreError: 69355:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1720.454930] LustreError: 69556:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 1720.457523] LustreError: 69556:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 1720.582901] Lustre: server umount lustre-MDT0001 complete [ 1726.629117] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 21:43:38 (1763347418) [ 1733.087686] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1741.135317] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1756.808922] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 1764.040339] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1769.375062] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1773.032932] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1777.321090] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1782.296222] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1788.097506] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1788.158568] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1788.350358] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1788.374916] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1788.470653] Lustre: lustre-MDT0000: new disk, initializing [ 1788.569184] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1788.595603] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1792.133625] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1800.151936] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1800.207595] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1800.267275] Lustre: 73791:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1800.302925] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1800.306492] Lustre: Skipped 1 previous similar message [ 1800.357176] Lustre: lustre-MDT0001: new disk, initializing [ 1800.418481] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1800.443586] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1800.449089] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1802.724135] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1807.672392] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1809.998927] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1814.098142] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1814.138058] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1814.285138] Lustre: lustre-OST0000: new disk, initializing [ 1814.287706] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1814.349484] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1818.150772] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1823.753913] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1823.789054] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1823.796960] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1823.911116] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1826.560498] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1826.712946] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1829.726322] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1829.854098] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1834.467425] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1834.468497] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1834.476973] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1834.476983] Lustre: Skipped 2 previous similar messages [ 1834.477305] Lustre: Skipped 2 previous similar messages [ 1837.581675] LustreError: 76727:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1837.587185] LustreError: 76727:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1837.714860] Lustre: server umount lustre-OST0000 complete [ 1841.642923] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1841.646586] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1841.662863] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1841.665592] Lustre: Skipped 1 previous similar message [ 1847.102394] LustreError: 76929:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1847.112606] LustreError: 76929:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1847.333222] Lustre: server umount lustre-MDT0000 complete [ 1849.840187] LustreError: 73802:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1849.858438] LustreError: 73802:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1851.267872] LustreError: 74570:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763347544 with bad export cookie 5393854664336702860 [ 1851.277547] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1851.298822] LustreError: 74570:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1851.561931] Lustre: server umount lustre-MDT0001 complete [ 1860.000650] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 21:45:51 (1763347551) [ 1865.260701] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1865.617023] LustreError: 77802:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1865.679189] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1868.509268] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1870.824326] LustreError: 77802:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1874.697387] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1878.364987] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1882.744748] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1885.742249] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1890.919541] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1895.046362] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1898.624228] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1900.871286] Lustre: 80136:0:(genops.c:1791:obd_export_evict_by_uuid()) MGS: evicting 8f0ca94c-60d6-4c02-b00c-e4280abffc2e at adminstrative request [ 1901.536435] LustreError: MGC192.168.204.125@tcp: operation ldlm_enqueue to node 0@lo failed: rc = -107 [ 1901.540787] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1901.551227] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1901.553357] Lustre: 77793:0:(mgc_request.c:1910:mgc_process_log()) MGC192.168.204.125@tcp: IR log lustre-mdtir failed, not fatal: rc = -107 [ 1911.782336] Lustre: MGS: Client 8f0ca94c-60d6-4c02-b00c-e4280abffc2e (at 0@lo) reconnecting [ 1911.787186] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x4adad23d45df80fe to 0x4adad23d45df8389 [ 1911.793861] Lustre: MGC192.168.204.125@tcp: Connection restored to 0@lo (at 0@lo) [ 1936.283691] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1936.354751] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1936.466362] Lustre: lustre-OST0001: new disk, initializing [ 1936.471656] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1936.531275] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1936.537229] Lustre: Skipped 2 previous similar messages [ 1940.687758] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1942.077705] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1942.088141] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1942.156575] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1946.324987] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1952.736463] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1952.742482] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1952.746978] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1952.752056] Lustre: Skipped 2 previous similar messages [ 1952.756463] Lustre: Skipped 2 previous similar messages [ 1954.506096] LustreError: 81276:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup [ 1954.511056] LustreError: 81276:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 1954.570377] Lustre: server umount lustre-OST0001 complete [ 1957.859531] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1957.880659] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1962.980699] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1962.981771] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1962.986116] Lustre: Skipped 4 previous similar messages [ 1963.600791] Lustre: server umount lustre-OST0000 complete [ 1967.077089] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1967.088471] LustreError: Skipped 1 previous similar message [ 1967.095289] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1967.105530] Lustre: Skipped 2 previous similar messages [ 1980.383165] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1980.450554] LustreError: 81678:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 1980.453299] LustreError: 81678:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1980.498575] Lustre: server umount lustre-MDT0000 complete [ 1983.326520] LustreError: 77783:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763347676 with bad export cookie 5393854664336704393 [ 1983.328219] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1983.331213] LustreError: 77783:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 1983.549873] Lustre: server umount lustre-MDT0001 complete [ 1990.073325] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 21:48:02 (1763347682) [ 1991.532977] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1993.219869] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 21:48:05 (1763347685) [ 1994.604573] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1996.190487] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 21:48:08 (1763347688) [ 1997.535947] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1999.220528] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 21:48:11 (1763347691) [ 2000.444742] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2004.487042] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2005.221962] loop: module loaded [ 2005.232789] loop0: detected capacity change from 0 to 4294967296 [ 2005.268339] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2006.368717] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2008.593384] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2011.123365] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2016.584171] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2019.182837] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2022.093696] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2025.070189] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2030.300437] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2030.359808] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2030.394297] LustreError: 84456:0:(obd_config.c:783:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2030.397899] LustreError: 84456:0:(obd_mount.c:193:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2030.401335] LustreError: 84456:0:(tgt_mount.c:2447:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2030.407202] LustreError: 84456:0:(super25.c:199:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2043.728471] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2050.209575] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2056.167424] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2060.817844] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2065.013326] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2068.785628] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2073.189621] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2073.233742] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2073.410163] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2073.436960] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2073.490932] Lustre: lustre-MDT0000: new disk, initializing [ 2073.566208] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2073.581393] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2076.447445] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2083.535772] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2083.580869] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2083.633976] Lustre: 87297:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2083.846604] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2086.228775] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2091.724428] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2094.435360] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2099.802866] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2099.857369] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2103.763058] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2105.877695] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2105.950717] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2109.473428] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2112.773957] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2113.004304] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2116.451820] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2116.661341] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2121.186474] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2121.187527] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2121.194494] Lustre: Skipped 1 previous similar message [ 2121.199249] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2121.200124] LustreError: Skipped 1 previous similar message [ 2121.203741] Lustre: Skipped 7 previous similar messages [ 2124.360643] LustreError: 90233:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 2124.368139] LustreError: 90233:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2124.470953] Lustre: server umount lustre-OST0000 complete [ 2133.531431] Lustre: server umount lustre-MDT0000 complete [ 2136.251025] LustreError: 87289:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763347829 with bad export cookie 5393854664336704995 [ 2136.254459] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2136.262819] LustreError: 87289:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2136.580400] Lustre: server umount lustre-MDT0001 complete [ 2144.308396] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 21:50:36 (1763347836) [ 2149.076329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2149.420471] LustreError: 91309:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2149.433956] LustreError: 91309:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2152.190042] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2158.060329] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2160.708799] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2165.272253] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2168.234673] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2173.794528] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2178.586509] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2183.610383] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2187.023301] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2187.170245] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2190.286398] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2190.503924] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2196.233455] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2196.275702] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2196.385976] Lustre: lustre-OST0001: new disk, initializing [ 2196.388113] Lustre: Skipped 2 previous similar messages [ 2196.393484] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2196.400773] Lustre: Skipped 3 previous similar messages [ 2200.951473] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2205.755076] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2205.759080] Lustre: Skipped 2 previous similar messages [ 2205.765737] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2205.838931] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2206.573587] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2209.573652] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2209.713570] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2212.292506] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2212.461584] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2228.186327] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2253.240426] Lustre: Failing over lustre-MDT0000 [ 2253.549321] LustreError: 96214:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 2253.551373] LustreError: 96214:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2253.634494] Lustre: server umount lustre-MDT0000 complete [ 2255.191493] LustreError: 91303:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2255.216845] LustreError: 91303:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2255.841262] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2255.849726] LustreError: Skipped 1 previous similar message [ 2255.857058] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2255.874408] Lustre: Skipped 3 previous similar messages [ 2273.759104] Lustre: 64423:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763347951/real 1763347951] req@0000000062a440cf x1849003678603520/t0(0) o400->MGC192.168.204.125@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1763347967 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2273.784640] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2274.701823] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2274.703602] LDISKFS-fs (dm-0): recovery complete [ 2274.717491] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2284.009491] LustreError: 64422:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@0000000029c87fe5 x1849003678612608/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2284.330502] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2284.336711] Lustre: Skipped 6 previous similar messages [ 2284.397953] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2285.883354] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2285.885958] Lustre: 91305:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2287.420857] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2289.633180] Lustre: 91308:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2289.640206] Lustre: 91308:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 1 previous similar message [ 2289.650206] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 2289.686336] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2290.007106] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2290.330246] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2290.335947] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 1 previous similar message [ 2290.663126] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2290.671167] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 1 previous similar message [ 2290.687591] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2290.693157] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 7 previous similar messages [ 2291.349387] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2291.360333] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 2 previous similar messages [ 2291.679885] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2291.683141] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 2 previous similar messages [ 2292.971073] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2292.992427] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 6 previous similar messages [ 2293.635493] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2293.652088] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 6 previous similar messages [ 2293.968678] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2293.974106] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 6 previous similar messages [ 2297.152092] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2297.165919] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 12 previous similar messages [ 2297.803859] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2297.811925] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 12 previous similar messages [ 2298.127129] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2298.138449] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 12 previous similar messages [ 2305.443146] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2305.449928] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 25 previous similar messages [ 2306.100195] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2306.110931] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 25 previous similar messages [ 2306.439123] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2306.446194] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 25 previous similar messages [ 2321.753065] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2321.782587] Lustre: 96962:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 50 previous similar messages [ 2322.122984] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2322.129935] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 49 previous similar messages [ 2322.447143] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2322.451310] LustreError: 96962:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 49 previous similar messages [ 2345.279752] Lustre: 96962:0:(ldlm_lib.c:2375:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2345.284724] Lustre: 96962:0:(ldlm_lib.c:2385:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2345.289657] Lustre: 96962:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client d84918df-1266-468e-b5c5-35e746566c03@192.168.204.25@tcp [ 2345.296651] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2345.302422] Lustre: 96962:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@0000000009f2cf0b x1849003665852928/t0(8589934771) o101->d84918df-1266-468e-b5c5-35e746566c03@192.168.204.25@tcp:249/0 lens 592/0 e 0 to 0 dl 1763348049 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2345.318076] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2345.335347] Lustre: lustre-MDT0000: Denying connection for new client d84918df-1266-468e-b5c5-35e746566c03 (at 192.168.204.25@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) already passed deadline 0:00 [ 2345.340685] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2345.377506] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2345.380512] Lustre: Skipped 2 previous similar messages [ 2345.382507] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2345.406806] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:77 to 0x280000401:577) [ 2345.407139] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 2357.728271] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2357.731774] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2357.738869] Lustre: Skipped 3 previous similar messages [ 2357.742661] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2357.745597] Lustre: Skipped 3 previous similar messages [ 2362.776582] Lustre: server umount lustre-OST0000 complete [ 2366.436130] LustreError: 97330:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2366.445995] LustreError: 97330:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 46 previous similar messages [ 2379.232046] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2379.346163] Lustre: server umount lustre-OST0001 complete [ 2388.254580] LustreError: 98027:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 2388.257289] LustreError: 98027:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 2388.371572] Lustre: server umount lustre-MDT0000 complete [ 2390.881226] LustreError: 91290:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348084 with bad export cookie 5393854664336756200 [ 2390.888848] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2391.146678] Lustre: server umount lustre-MDT0001 complete [ 2397.443387] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 21:54:49 (1763348089) [ 2402.709765] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2402.714410] Lustre: *** cfs_fail_loc=197, val=0*** [ 2418.210267] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2423.327467] LustreError: 98920:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.125@tcp: failed processing log, type 4: rc = -110 [ 2428.473195] Lustre: *** cfs_fail_loc=197, val=0*** [ 2428.474675] Lustre: Skipped 65 previous similar messages [ 2452.668613] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2455.921357] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2457.151902] Lustre: server umount lustre-OST0000 complete [ 2462.387242] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 21:55:54 (1763348154) [ 2478.728670] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2478.986723] LustreError: 100429:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2478.996608] LustreError: 100429:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2480.842937] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2485.309626] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2488.326412] LustreError: 100460:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2488.333455] LustreError: 100460:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2488.344051] LustreError: 100460:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 9, retries 0, failed: rc = -5 [ 2488.535646] Lustre: server umount lustre-MDT0000 complete [ 2498.767264] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2509.837461] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2515.941546] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2523.671251] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2528.077874] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2532.207794] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2536.686322] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2540.714495] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2540.751182] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2540.891412] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2540.911533] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2540.960426] Lustre: lustre-MDT0000: new disk, initializing [ 2541.012151] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2541.015629] Lustre: Skipped 2 previous similar messages [ 2541.029428] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2543.369455] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2550.068106] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2550.104927] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2550.161976] Lustre: 104496:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2550.338943] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2552.677808] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2558.181994] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2560.612840] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2565.225471] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2565.276596] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2568.807160] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2572.392075] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2573.963714] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2577.035940] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2577.205726] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2580.527945] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2580.702293] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2582.499202] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2582.500632] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2582.502294] LustreError: Skipped 5 previous similar messages [ 2582.508886] Lustre: Skipped 5 previous similar messages [ 2582.510526] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2582.515808] Lustre: Skipped 12 previous similar messages [ 2596.319153] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2596.465697] Lustre: server umount lustre-OST0000 complete [ 2613.215739] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2613.333606] Lustre: server umount lustre-MDT0000 complete [ 2615.513751] LustreError: 104486:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348309 with bad export cookie 5393854664336766770 [ 2615.519026] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2615.526093] LustreError: 104486:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 2615.744126] Lustre: server umount lustre-MDT0001 complete [ 2622.007092] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 21:58:34 (1763348314) [ 2628.102168] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 2630.167366] Key type lgssc unregistered [ 2630.412250] LNet: 108565:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2630.422260] LNetError: 108565:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2630.433598] LNet: Removed LNI 192.168.204.125@tcp [ 2631.035826] Key type .llcrypt unregistered [ 2631.037776] Key type ._llcrypt unregistered [ 2644.781387] Key type ._llcrypt registered [ 2644.782870] Key type .llcrypt registered [ 2644.876975] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2657.885742] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2658.747112] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2658.836175] alg: No test for adler32 (adler32-zlib) [ 2659.851352] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 2660.079515] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 2661.711381] Key type lgssc registered [ 2662.493779] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2668.684462] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2673.960507] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2678.600425] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2683.454849] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2687.624865] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2693.184847] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2693.227492] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2693.238178] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2694.483744] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2694.517176] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2694.586606] Lustre: lustre-MDT0000: new disk, initializing [ 2694.677149] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2694.700366] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2698.250734] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2706.663742] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2706.715669] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2706.872219] Lustre: lustre-OST0000: new disk, initializing [ 2706.877437] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2706.880526] Lustre: Skipped 1 previous similar message [ 2706.947634] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2709.646642] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2709.672477] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2709.712211] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2711.166384] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2719.927127] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2719.984836] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2720.123944] Lustre: lustre-OST0001: new disk, initializing [ 2720.126757] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2720.196247] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2724.555483] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2726.530493] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2726.535307] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2726.569089] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2731.493519] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2731.494374] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2731.499704] Lustre: Skipped 1 previous similar message [ 2736.609144] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2736.611932] Lustre: Skipped 2 previous similar messages [ 2737.509335] LustreError: 114145:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup [ 2737.633130] Lustre: server umount lustre-MDT0000 complete [ 2742.060412] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2744.702313] LustreError: 114146:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348438 with bad export cookie 6860070782132740770 [ 2744.707694] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2744.737082] LustreError: 114740:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 2744.740825] LustreError: 114740:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 2744.771955] Lustre: server umount lustre-OST0000 complete [ 2746.780167] LustreError: 114940:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 2746.782178] LustreError: 114940:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 2746.853508] Lustre: server umount lustre-OST0001 complete [ 2752.800443] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 22:00:44 (1763348444) [ 2759.337224] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2764.580618] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2765.364854] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2769.420599] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2770.138853] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2774.044416] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 22:01:06 (1763348466) [ 2781.149272] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2782.506982] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2783.689241] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2784.794714] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2785.324645] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2786.350892] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2796.151287] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2802.223244] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2808.999204] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2813.451088] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2817.319052] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2821.281891] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2825.612996] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2825.655858] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2825.811104] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2825.845700] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2825.909181] Lustre: lustre-MDT0000: new disk, initializing [ 2825.997360] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2826.014421] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2829.004751] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2838.301951] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2838.352790] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2838.425166] Lustre: 120274:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2838.481697] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2838.484256] Lustre: Skipped 1 previous similar message [ 2838.545889] Lustre: lustre-MDT0001: new disk, initializing [ 2838.632567] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2838.673051] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2838.680165] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2841.354542] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2847.262261] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2849.843736] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2855.213194] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2855.260515] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2855.431430] Lustre: lustre-OST0000: new disk, initializing [ 2855.433689] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2855.511113] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2859.362236] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2862.171438] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2862.185521] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2862.259268] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2865.758446] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2868.748730] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2868.892703] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2871.739626] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2871.878592] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2877.922067] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2877.922869] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2877.925607] LustreError: Skipped 1 previous similar message [ 2877.933041] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2877.938038] Lustre: Skipped 1 previous similar message [ 2879.424208] LustreError: 123209:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 2879.432715] LustreError: 123209:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 2879.510729] Lustre: server umount lustre-OST0000 complete [ 2883.041042] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2883.047788] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2883.050631] Lustre: Skipped 2 previous similar messages [ 2888.160416] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2888.165633] Lustre: Skipped 2 previous similar messages [ 2896.351123] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2896.431414] LustreError: 123411:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2896.435736] LustreError: 123411:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 2896.485214] Lustre: server umount lustre-MDT0000 complete [ 2898.942866] LustreError: 120265:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348592 with bad export cookie 6860070782132741995 [ 2898.947297] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2898.955555] LustreError: 120265:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 2899.152365] Lustre: server umount lustre-MDT0001 complete [ 2904.171979] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 22:03:16 (1763348596) [ 2908.294673] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2908.517396] LustreError: 124283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2908.530298] LustreError: 124283:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2908.566259] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2910.920050] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2913.761898] LustreError: 124283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2916.537501] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2918.782896] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2922.045872] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2924.424123] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2928.897439] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2933.420671] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2938.028866] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2945.441768] Lustre: *** cfs_fail_loc=159, val=0*** [ 2961.758099] Lustre: lustre-MDT0000: Client 6867262d-3494-46e5-8644-416e8205e38d (at 192.168.204.25@tcp) reconnecting [ 2962.900692] Lustre: *** cfs_fail_loc=159, val=0*** [ 2962.907636] Lustre: Skipped 5 previous similar messages [ 2979.159594] Lustre: lustre-MDT0000: Client 6867262d-3494-46e5-8644-416e8205e38d (at 192.168.204.25@tcp) reconnecting [ 2982.368404] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2982.372078] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2982.386060] Lustre: Skipped 1 previous similar message [ 2982.403268] Lustre: Skipped 3 previous similar messages [ 2988.215031] LustreError: 126772:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 2988.220759] LustreError: 126772:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 2988.328891] Lustre: server umount lustre-OST0000 complete [ 2992.608031] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2992.630318] Lustre: Skipped 1 previous similar message [ 2997.648481] Lustre: server umount lustre-MDT0000 complete [ 2997.730544] LustreError: 124277:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2997.742033] LustreError: 124277:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3000.575437] LustreError: 124262:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348694 with bad export cookie 6860070782132742870 [ 3000.578410] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3000.588652] LustreError: 124262:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3000.859127] Lustre: server umount lustre-MDT0001 complete [ 3008.365649] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3010.239573] Key type lgssc unregistered [ 3010.456957] LNet: 127708:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3010.461588] LNetError: 127708:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3010.471865] LNet: Removed LNI 192.168.204.125@tcp [ 3010.971267] Key type .llcrypt unregistered [ 3010.972771] Key type ._llcrypt unregistered [ 3027.499929] Key type ._llcrypt registered [ 3027.501940] Key type .llcrypt registered [ 3027.557721] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3028.122363] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3028.143419] alg: No test for adler32 (adler32-zlib) [ 3029.144689] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3029.300691] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3030.943322] Key type lgssc registered [ 3031.820912] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3038.546354] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3038.565652] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3039.931154] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3043.113285] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3049.446063] LustreError: 129084:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3049.470459] LustreError: 129084:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3050.230736] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3050.596453] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3054.036218] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3059.208412] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3062.401333] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3067.953896] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3068.254084] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3072.630803] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3077.685258] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3084.660341] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3095.098275] Lustre: *** cfs_fail_loc=159, val=0*** [ 3111.259976] Lustre: lustre-MDT0000: Client d51eb52e-c5ab-49c0-bb46-c38a23fb0d27 (at 192.168.204.25@tcp) reconnecting [ 3113.313878] Lustre: *** cfs_fail_loc=159, val=0*** [ 3129.742769] Lustre: lustre-MDT0001: Client d51eb52e-c5ab-49c0-bb46-c38a23fb0d27 (at 192.168.204.25@tcp) reconnecting [ 3131.351624] Lustre: *** cfs_fail_loc=159, val=0*** [ 3131.362162] Lustre: Skipped 3 previous similar messages [ 3147.664993] Lustre: lustre-MDT0001: Client d51eb52e-c5ab-49c0-bb46-c38a23fb0d27 (at 192.168.204.25@tcp) reconnecting [ 3151.072649] Lustre: 131810:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3153.838146] Lustre: *** cfs_fail_loc=159, val=0*** [ 3153.839860] Lustre: Skipped 3 previous similar messages [ 3170.142411] Lustre: lustre-MDT0000: Client d451eda4-1f57-4e3d-8354-6b7bc91bdc28 (at 192.168.204.25@tcp) reconnecting [ 3171.285195] Lustre: *** cfs_fail_loc=159, val=0*** [ 3171.287129] Lustre: Skipped 14 previous similar messages [ 3187.628214] Lustre: lustre-MDT0000: Client d451eda4-1f57-4e3d-8354-6b7bc91bdc28 (at 192.168.204.25@tcp) reconnecting [ 3188.855452] Lustre: 132107:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3193.315977] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3193.319412] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3193.327727] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3197.412432] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3197.414689] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3197.415787] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3197.425054] Lustre: Skipped 1 previous similar message [ 3199.105098] LustreError: 132207:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3199.263167] Lustre: server umount lustre-OST0000 complete [ 3202.529115] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3202.532460] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3202.547558] Lustre: Skipped 1 previous similar message [ 3202.560274] Lustre: Skipped 1 previous similar message [ 3207.649401] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3207.652959] Lustre: Skipped 1 previous similar message [ 3208.617139] LustreError: 132408:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3208.625404] LustreError: 132408:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3208.721173] Lustre: server umount lustre-MDT0000 complete [ 3212.405721] LustreError: 131934:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348906 with bad export cookie 6571197874818647571 [ 3212.407870] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3212.450550] LustreError: 131934:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3212.548214] LustreError: 132610:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3212.552172] LustreError: 132610:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3212.744789] Lustre: server umount lustre-MDT0001 complete [ 3223.248884] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3226.061452] Key type lgssc unregistered [ 3226.391314] LNet: 133141:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3226.401159] LNetError: 133141:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3226.417057] LNet: Removed LNI 192.168.204.125@tcp [ 3227.269875] Key type .llcrypt unregistered [ 3227.271601] Key type ._llcrypt unregistered [ 3249.595043] Key type ._llcrypt registered [ 3249.596745] Key type .llcrypt registered [ 3249.713415] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3250.493702] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3250.514354] alg: No test for adler32 (adler32-zlib) [ 3251.547586] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3251.736249] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3253.383190] Key type lgssc registered [ 3254.451621] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3260.809559] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3260.833703] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3262.153260] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3264.875725] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3271.650495] LustreError: 134537:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3271.662015] LustreError: 134537:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3272.026235] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3272.332737] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3275.337686] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3279.873867] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3283.237337] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3289.189543] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3289.497594] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3293.894882] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3296.715482] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3298.952625] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3307.009466] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3314.524877] Lustre: 136806:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3317.359540] Lustre: 136855:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3319.078561] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3319.961864] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3322.593900] Lustre: 137002:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3323.389938] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3324.150611] Lustre: 137100:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3327.457993] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3327.459593] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3327.459880] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3327.465579] Lustre: Skipped 1 previous similar message [ 3332.579630] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3332.599895] Lustre: Skipped 2 previous similar messages [ 3333.121127] LustreError: 137208:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3333.370201] Lustre: server umount lustre-OST0000 complete [ 3337.698453] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3337.710733] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3337.722044] Lustre: Skipped 1 previous similar message [ 3342.819869] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3342.831148] Lustre: Skipped 1 previous similar message [ 3343.446978] LustreError: 137409:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3343.458580] LustreError: 137409:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3343.718059] Lustre: server umount lustre-MDT0000 complete [ 3347.940683] LustreError: 135611:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3347.976379] LustreError: 135611:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3348.065803] LustreError: 134517:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349041 with bad export cookie 2151132078389009003 [ 3348.069096] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3348.126891] LustreError: 134517:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3348.426894] LustreError: 137611:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3348.447310] LustreError: 137611:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3348.649930] Lustre: server umount lustre-MDT0001 complete [ 3357.787428] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3359.782538] Key type lgssc unregistered [ 3360.010121] LNet: 138142:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3360.019630] LNetError: 138142:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3361.064637] LNet: Removed LNI 192.168.204.125@tcp [ 3361.647567] Key type .llcrypt unregistered [ 3361.650612] Key type ._llcrypt unregistered [ 3379.821889] Key type ._llcrypt registered [ 3379.823515] Key type .llcrypt registered [ 3379.882673] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3380.600764] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3380.610277] alg: No test for adler32 (adler32-zlib) [ 3381.563504] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3381.733579] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3383.384272] Key type lgssc registered [ 3384.313305] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3390.571321] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3390.590765] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3391.995427] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3395.275543] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3402.213779] LustreError: 139517:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3402.230720] LustreError: 139517:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3403.619780] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3403.898392] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3407.850793] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3414.004821] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3418.756578] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3426.079557] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3426.490259] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3428.555091] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3432.416020] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3436.732235] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3437.067976] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3443.452611] Lustre: *** cfs_fail_loc=159, val=0*** [ 3443.454516] Lustre: Skipped 1 previous similar message [ 3458.932558] Lustre: lustre-MDT0000: Client 19056e12-e66c-40c7-bd64-021da2c0dc3f (at 192.168.204.25@tcp) reconnecting [ 3464.672967] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3464.676746] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3464.700310] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3465.199372] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 3465.202400] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3465.217203] LustreError: Skipped 1 previous similar message [ 3465.234546] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3465.360895] LustreError: 141895:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3465.542909] Lustre: server umount lustre-OST0000 complete [ 3470.303879] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3470.325161] LustreError: Skipped 6 previous similar messages [ 3470.334505] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3470.349173] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3472.864448] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3472.868817] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3475.631809] LustreError: 142097:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3475.642707] LustreError: 142097:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3475.711256] Lustre: server umount lustre-MDT0000 complete [ 3477.987650] LustreError: 139516:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3477.994931] LustreError: 139516:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3478.482372] LustreError: 139496:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349172 with bad export cookie 6780758033713287078 [ 3478.487783] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3478.505946] LustreError: 139496:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3478.636450] LustreError: 142298:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3478.662270] LustreError: 142298:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3478.859591] Lustre: server umount lustre-MDT0001 complete [ 3488.963631] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3491.032327] Key type lgssc unregistered [ 3491.237394] LNet: 142829:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3491.242508] LNetError: 142829:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3491.250740] LNet: Removed LNI 192.168.204.125@tcp [ 3491.919636] Key type .llcrypt unregistered [ 3491.921916] Key type ._llcrypt unregistered [ 3509.607081] Key type ._llcrypt registered [ 3509.608807] Key type .llcrypt registered [ 3509.668807] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3510.292249] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3510.364934] alg: No test for adler32 (adler32-zlib) [ 3511.278992] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3511.470082] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3513.143167] Key type lgssc registered [ 3514.109514] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3521.224428] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3521.243431] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3522.722382] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3526.504220] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3533.284990] LustreError: 144205:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3533.309396] LustreError: 144205:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3534.719501] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3535.296368] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3538.988303] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3544.159377] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3547.929511] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3554.796096] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3555.084162] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3560.235868] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3560.370204] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3565.270323] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3567.442711] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3588.654451] Lustre: lustre-OST0000: evicting ba3dc11b-a951-4f5d-a5d1-846a3479cb97 (at 192.168.204.25@tcp) by administrative request [ 3588.659561] Lustre: Skipped 1 previous similar message [ 3616.737974] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3616.741271] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3616.755356] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3618.786021] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3618.789433] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3618.789802] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3618.798165] Lustre: Skipped 1 previous similar message [ 3621.379768] LustreError: 146986:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3621.470906] Lustre: server umount lustre-OST0000 complete [ 3627.500773] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3627.518832] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3627.543955] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3630.646088] LustreError: 147187:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3630.653965] LustreError: 147187:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3630.732396] Lustre: server umount lustre-MDT0000 complete [ 3633.871313] LustreError: 144186:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349327 with bad export cookie 10954232996843288840 [ 3633.874731] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3633.879554] LustreError: 144186:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3633.996829] LustreError: 147389:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3634.020274] LustreError: 147389:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3634.163764] Lustre: server umount lustre-MDT0001 complete [ 3641.415845] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3643.368734] Key type lgssc unregistered [ 3643.667674] LNet: 147921:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3643.674413] LNetError: 147921:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3643.691371] LNet: Removed LNI 192.168.204.125@tcp [ 3644.263869] Key type .llcrypt unregistered [ 3644.266375] Key type ._llcrypt unregistered [ 3697.257667] Key type ._llcrypt registered [ 3697.259553] Key type .llcrypt registered [ 3697.327816] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3697.944424] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3698.036593] alg: No test for adler32 (adler32-zlib) [ 3699.030848] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3699.255560] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3700.911230] Key type lgssc registered [ 3701.753936] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3707.695725] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3707.718276] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3709.122235] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3712.441932] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3718.626813] LustreError: 150366:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3718.654940] LustreError: 150366:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3719.355510] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3719.702919] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3722.655434] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3727.128274] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3729.975347] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3737.179837] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3737.489502] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3743.299603] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3744.695653] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3747.787989] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3753.913353] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3764.192394] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3764.198092] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3764.212942] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3764.226141] Lustre: Skipped 1 previous similar message [ 3764.257949] Lustre: Skipped 1 previous similar message [ 3767.551144] LustreError: 152642:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3767.666381] Lustre: server umount lustre-OST0000 complete [ 3770.852847] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3770.857099] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3770.872203] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3774.433809] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3774.434375] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3774.449653] Lustre: Skipped 1 previous similar message [ 3776.769540] LustreError: 152845:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3776.772410] LustreError: 152845:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3776.881485] Lustre: server umount lustre-MDT0000 complete [ 3779.555445] LustreError: 150366:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3779.566955] LustreError: 150366:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3780.232949] LustreError: 150348:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349473 with bad export cookie 12815458572395657665 [ 3780.251892] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3780.403614] LustreError: 153046:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3780.413672] LustreError: 153046:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3780.622428] Lustre: server umount lustre-MDT0001 complete [ 3789.707711] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3791.863658] Key type lgssc unregistered [ 3792.150513] LNet: 153580:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3792.159708] LNetError: 153580:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3793.191413] LNet: Removed LNI 192.168.204.125@tcp [ 3793.988634] Key type .llcrypt unregistered [ 3793.995456] Key type ._llcrypt unregistered [ 3815.825214] Key type ._llcrypt registered [ 3815.827862] Key type .llcrypt registered [ 3815.912974] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3816.591222] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3816.606788] alg: No test for adler32 (adler32-zlib) [ 3817.713077] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3817.969658] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3819.623166] Key type lgssc registered [ 3820.607350] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3825.915098] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3832.276217] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 22:18:44 (1763349524) [ 3844.070904] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 3852.296863] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3859.295935] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3864.229489] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3868.365835] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3873.089961] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3879.215165] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3879.263535] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3879.274485] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3880.483098] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3880.524543] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3880.607528] Lustre: lustre-MDT0000: new disk, initializing [ 3880.677307] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3880.692363] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3883.644370] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3891.744231] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3891.792808] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3891.864552] Lustre: 157798:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3891.908630] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3891.911528] Lustre: Skipped 1 previous similar message [ 3891.960519] Lustre: lustre-MDT0001: new disk, initializing [ 3892.034145] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3892.072819] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3892.081096] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3894.634347] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3900.137438] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3903.319218] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3908.351801] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 3908.409426] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3908.567299] Lustre: lustre-OST0000: new disk, initializing [ 3908.572638] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3908.646556] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3912.513219] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3918.369551] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3918.374504] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3918.470178] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3918.535544] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3928.547396] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3928.547990] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3928.548211] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3928.554481] Lustre: Skipped 1 previous similar message [ 3933.670716] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3933.675016] Lustre: Skipped 1 previous similar message [ 3938.789468] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3938.793692] Lustre: Skipped 1 previous similar message [ 3939.296132] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3939.338104] LustreError: 160384:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 3939.444888] Lustre: server umount lustre-OST0000 complete [ 3943.394235] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3943.397182] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3943.417401] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3943.431352] Lustre: Skipped 1 previous similar message [ 3949.025465] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3949.039332] Lustre: Skipped 2 previous similar messages [ 3957.215138] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3957.302944] LustreError: 160588:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3957.311076] LustreError: 160588:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3957.384893] Lustre: server umount lustre-MDT0000 complete [ 3960.652866] LustreError: 157792:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349654 with bad export cookie 15120541238529107512 [ 3960.659468] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3960.663601] LustreError: 157792:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3960.791652] LustreError: 160790:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3960.815148] LustreError: 160790:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3960.938343] Lustre: server umount lustre-MDT0001 complete [ 3970.266056] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3972.572582] Key type lgssc unregistered [ 3972.788113] LNet: 161322:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3972.796410] LNetError: 161322:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3972.813870] LNet: Removed LNI 192.168.204.125@tcp [ 3973.587419] Key type .llcrypt unregistered [ 3973.589079] Key type ._llcrypt unregistered [ 3994.808981] Key type ._llcrypt registered [ 3994.810669] Key type .llcrypt registered [ 3994.887578] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3995.532181] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3995.605776] alg: No test for adler32 (adler32-zlib) [ 3996.601485] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 3996.768541] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3998.407606] Key type lgssc registered [ 3999.338405] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4005.521839] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4005.538616] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4006.809645] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4009.308879] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 4016.500037] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4016.885761] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4020.187878] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 4025.066727] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4028.457245] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4035.247347] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4035.628695] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4040.761534] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 4044.803394] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4053.041896] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4061.539161] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4061.556930] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4061.569533] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4061.580596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.596793] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4062.614481] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4062.624744] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4062.632582] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4062.642674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.666162] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4063.613407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.630393] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4064.643808] Lustre: Skipped 1 previous similar message [ 4064.661092] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4064.668156] Lustre: Skipped 1 previous similar message [ 4064.673230] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4064.676260] Lustre: Skipped 1 previous similar message [ 4064.679916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.699606] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4064.702375] Lustre: Skipped 1 previous similar message [ 4065.797304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.779143] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4066.782756] Lustre: Skipped 1 previous similar message [ 4066.807812] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4066.822091] Lustre: Skipped 1 previous similar message [ 4066.827254] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4066.835052] Lustre: Skipped 1 previous similar message [ 4066.840921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.847956] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4066.850663] Lustre: Skipped 1 previous similar message [ 4067.749710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4068.628716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4069.426301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4070.464342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.649585] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4071.661413] Lustre: Skipped 4 previous similar messages [ 4071.697109] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4071.719184] Lustre: Skipped 4 previous similar messages [ 4071.727106] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4071.740590] Lustre: Skipped 4 previous similar messages [ 4071.752620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.769476] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4071.781564] Lustre: Skipped 4 previous similar messages [ 4072.733891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4073.721133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4074.590985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.474201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4076.250673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.017731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.693858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.309371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.944549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4079.624437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.485317] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4080.497892] Lustre: Skipped 10 previous similar messages [ 4080.515549] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4080.530983] Lustre: Skipped 10 previous similar messages [ 4080.535304] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4080.537984] Lustre: Skipped 10 previous similar messages [ 4080.542122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.553131] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4080.558640] Lustre: Skipped 10 previous similar messages [ 4081.380375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4082.302829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4083.082077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4084.091443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.256319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4086.533102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4087.629981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.416057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.349162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4090.194694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.054583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.810854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4092.609790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.769428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.668455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4095.616041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.422665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.314838] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4097.328174] Lustre: Skipped 17 previous similar messages [ 4097.339191] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4097.346532] Lustre: Skipped 17 previous similar messages [ 4097.356545] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4097.360040] Lustre: Skipped 17 previous similar messages [ 4097.362716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.371826] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4097.395071] Lustre: Skipped 17 previous similar messages [ 4098.221398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.993490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4099.745983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.514795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.291863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4102.073922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4102.952818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4103.751977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4104.586094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.421046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.140057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.873315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4107.630756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.550605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4109.335543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.188103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.988182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.853826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4112.709771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4113.631831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.418437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4115.268456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.136748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.061751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.818175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4118.640645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4119.388488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.151536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.939789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4121.764221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.784868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4123.784882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4124.551251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.307621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.022525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.739381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4127.407233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.074907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.853977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.523475] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4129.528984] Lustre: Skipped 39 previous similar messages [ 4129.546926] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4129.557959] Lustre: Skipped 39 previous similar messages [ 4129.563868] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4129.566432] Lustre: Skipped 39 previous similar messages [ 4129.581072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.587947] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4129.593484] Lustre: Skipped 39 previous similar messages [ 4130.351895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.060446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.707915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.437166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.133445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.962915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4134.658786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4135.367822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.060801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.721170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4137.519453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4138.185737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.007830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.651335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4140.345691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.126332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.884938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.690950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.566086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4144.291582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4145.094881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4145.816425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.563551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4147.321452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.206496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.892529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.642648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4150.490963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.199734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.051614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.965149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.701474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4154.387981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.111457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.818525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.660802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.301127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.863675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.478716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.121285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.720137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4160.390661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.036840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.690731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4162.470849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.327948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4164.144924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4164.891024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.695950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.426767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.499334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4168.291641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.208949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.965839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.838622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4171.623253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.379543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.141916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.991604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4174.772865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4175.578830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.297745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.995503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4177.644843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.479666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.125845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.937288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4180.741164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.548402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.359470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4183.401228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.321602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.076365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.915782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.719988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.430366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.338785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.094820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.801965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.603483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.303583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.057418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.942372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.662884] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4193.667069] Lustre: Skipped 83 previous similar messages [ 4193.683497] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4193.690772] Lustre: Skipped 83 previous similar messages [ 4193.697471] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4193.700640] Lustre: Skipped 83 previous similar messages [ 4193.718456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.730993] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4193.747182] Lustre: Skipped 83 previous similar messages [ 4194.386387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.140082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.926510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.714536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.551846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4198.344564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.319059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.134875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.100917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.944231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.927616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.832343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.818855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.760149] LustreError: 162734:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4205.768338] LustreError: 162734:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4205.780646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4206.519548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.332082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.075928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.799943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.581488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.338914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.055383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.952022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.717031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.510467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.453644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.431628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.229992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.182671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4218.119024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.042681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.882069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.884362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.845407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4222.671498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.687516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.612425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.398572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.160201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.950409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.759722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4228.562242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.208420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4230.042375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.075710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.845891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.655240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.592164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.409133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.201704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.958431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4236.819472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.666448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.387056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.184504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.117794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.967518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.846583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.550687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.374521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.218350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.948749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4245.703891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.480172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.177501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.946922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.800187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.793952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4250.739399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4251.634743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4252.350692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.217416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.173952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.097841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.948478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4256.826344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4257.585175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4258.476828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.256548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.097039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.953361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.061777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.262978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4264.102839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.126290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.024621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.119363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4268.215715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.145909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.931797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.927942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.890168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4272.612386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.307849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.090330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.005736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.686882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.415238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4277.030034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4277.784439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.486662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.348776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.250738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.094135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.970110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4282.718295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.670680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4284.612037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4285.438245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.260056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.053780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.903466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4288.852228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.691830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4290.402924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.054971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.702912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.354142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.983751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4293.709877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4294.426568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.159523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.995906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4296.718808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4297.355579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.025515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.706612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.370410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.020714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.726440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.533508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4302.436696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.304257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.243395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.108833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.947035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4306.779532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4307.633996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4308.392812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.198656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4310.193811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.091769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.948567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4312.856982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4313.552622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4314.323732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4315.054062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4315.808580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4316.625268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4317.431886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4318.283067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4319.016643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4319.827990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4320.507561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.208655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.889756] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4321.898665] Lustre: Skipped 154 previous similar messages [ 4321.908756] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4321.913980] Lustre: Skipped 154 previous similar messages [ 4321.917561] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4321.920557] Lustre: Skipped 154 previous similar messages [ 4321.924556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.934986] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4321.937630] Lustre: Skipped 154 previous similar messages [ 4322.787377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4323.544398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4324.291384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4324.990753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4325.804779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4326.721974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4327.577564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.343716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4329.150341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.016385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.726683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4331.504862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.324835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.989135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4333.578676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.223210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.849078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4335.566554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4336.267942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4337.010947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4337.750342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4338.454368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.219604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.904773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4340.632292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4341.374380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4342.217076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4343.192641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4343.990664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4344.806374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4345.628927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4346.484746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.266458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.923841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4348.457655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.108675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.848286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4350.439588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4351.084823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4351.760932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4352.454899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.201960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.861166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4354.606932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4355.345522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.176801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.865892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4357.588418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.248454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.996701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4359.649110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4360.341448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.022726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.691683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4362.371640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.018127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.704877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.376078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.083806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.803302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.559337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.360601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.183789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.013701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.772459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.517758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.279302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.990290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.565647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.388846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.125961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.022643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.004877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.881335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.714311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.517610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.346436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.376651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.336509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.171280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.919458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.828932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.722588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.525342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.369868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.212532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.204895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.019580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.953322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.741348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.498773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.298959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.075821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.748786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.458261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.228240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.894060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.652943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.572755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.365372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.181048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.337405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.256788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.304430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.208842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.227608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.041089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.758596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.551265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.352846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.009592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.641458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.363644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.921545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.551179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.335177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.091951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.805690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.463078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.462051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.210619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.968052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.785302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.655917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.604491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.505104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.430419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4421.215675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4421.917302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.750825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.420206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.424542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.183895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.945815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.847087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4427.878040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.949492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.842202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.784510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4431.644798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.456633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.385938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.131045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.239181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.018334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.715729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.511489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.291664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.034218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.990906] LustreError: 162734:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4439.997313] LustreError: 162734:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4439.999444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.824261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.768800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.600567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.393074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4444.230474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.080573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.751441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.454515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.190161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.938755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.583214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.337125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.088249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.805600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.481927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.179302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.881189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.526699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.204887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.985882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.880871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.535748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.257074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.956795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.660593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.359862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.048906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.666730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.272355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.975837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.730683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.457070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.187332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.870777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.546523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.347841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.037173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.672152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.321109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.083400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.814900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.560618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.276572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.896310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.510425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.374392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4474.112177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4475.018676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4475.819626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4476.751472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4477.529065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4478.429926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.213684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.019620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.731577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.500411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4482.252641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4483.110793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.017832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.831957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4485.689668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4486.432656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.110767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.691472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4488.402151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.213214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.884089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4490.675437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.597665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4492.402996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.279867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4494.225330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4495.424554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4496.235814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.098311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.819600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4498.796544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.797515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4500.735377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.586632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4502.494558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.372305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4504.292109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4505.447834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4506.514125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4507.453139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4508.392076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4509.240118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.094986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.839838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4511.602823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4512.439764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.133392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.931024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4514.736030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4515.554960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4516.565763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.263173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.920480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.729520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4519.666613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4520.529405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4521.349121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.141876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.986607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4523.752955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4524.701503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4525.455176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4526.255734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.047820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.987266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4528.953298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4529.695550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4530.324554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.053582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.899148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.610805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4533.299092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4534.172439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4535.261226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4536.224769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4537.151507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.060500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.870896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4539.856123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.756227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4541.580932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4542.765170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4543.754814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4544.635180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4545.458741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4546.616734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4547.533104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4548.377292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4549.086860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4550.062813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.297564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4552.418887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4553.579910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4554.436297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4555.336891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.309867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4557.098112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4557.974092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4558.960124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4559.592068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4560.223544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.079965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.863986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4562.575385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4563.388076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4564.114645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4564.808680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4565.696421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4566.641227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4567.569556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4568.328902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4569.301759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4570.355757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4571.329839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4572.221433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4573.340129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4574.071774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4574.904131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4575.793787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4576.713571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4578.108733] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4578.124321] Lustre: Skipped 316 previous similar messages [ 4578.145238] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4578.150480] Lustre: Skipped 316 previous similar messages [ 4578.154716] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4578.156861] Lustre: Skipped 316 previous similar messages [ 4578.163936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4578.180836] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4578.186054] Lustre: Skipped 316 previous similar messages [ 4579.260405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4580.309385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4581.255327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4582.069739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4583.025300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4583.812983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4584.550955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4585.184771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4585.837858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4586.486513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4587.223074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4587.928902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4588.701209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4589.739822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4590.469992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4591.489053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4592.485687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4593.448742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4594.399132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4595.293358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4595.952515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4596.917985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4597.737968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4598.700425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4599.782773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4600.708332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4601.755226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4602.551521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4603.439148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4604.496789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4605.596960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4606.620818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4607.568069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4608.445750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4609.270291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4610.159511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4611.230450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.082070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.830450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4613.686727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4614.592769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4615.426197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4616.266809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4617.176750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.283386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4619.200932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4620.041156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4620.869754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4621.691712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4622.526792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.232654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.878981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4624.610697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4625.254219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4625.930372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4626.738300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4627.537655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4628.321027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4628.981694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4629.661706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4630.466172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.158677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.952438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4632.752944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4633.595909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4634.322802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4635.036256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4635.738229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4636.451382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4637.318524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4638.127321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4638.830116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.629867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4640.321664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.189309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.964417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4642.764773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4643.560785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4644.434323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4645.212422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4645.967863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.747367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4647.635985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.483917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4649.304904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.233286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.921548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4651.713315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.509559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.345698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4654.141729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.055194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.836077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.711107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4657.587135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.373546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.224265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.960505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.717261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4661.527696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.360506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4663.179205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4664.155565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4665.226513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.126172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.067832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.021656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.969818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.970212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4671.086764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.030947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.879298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4673.679033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.676380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.498222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4676.254793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.171970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.269282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.083400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.141677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.939326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.747479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.705357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.568854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.539728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.522865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.463228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4687.358202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.357934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.198964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.008411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.800535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4691.558985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.344683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.231442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.944197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.715059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.477969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.278223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.030761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.916368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.733077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.526159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4700.306298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.020827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.873459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.649932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.457607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4704.213292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.043926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.786739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.587570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4707.530473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.510940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4709.352665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.179909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.030412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.995218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4712.883081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4713.741037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.477416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4715.372502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.208292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4717.179976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.065607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.959635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4719.920070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4720.819104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.758437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.586668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4723.551168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4724.366249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.254249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.218474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.134982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.100731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.054217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.882058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.630431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.504484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4732.339654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.148753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.108956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.034801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.819533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.763509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.473879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.337807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.165792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.015207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.705408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.568636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4742.379823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.152542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.905984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4744.633529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.449459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.296544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.134435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.975682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.714844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.464391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.160850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.917713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4751.673609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4752.404203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4753.167532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4754.070212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4754.762629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4755.666802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4756.557447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4757.396084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4758.125433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4759.065753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4759.805542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4760.634669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4761.607622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4762.495463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4763.556891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4764.428057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4765.222503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4766.011829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.035753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.837910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4768.694167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4769.446844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4770.297916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4771.088854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4771.851726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4772.573443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4773.295353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4774.298078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4775.150824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4776.109813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4776.895677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4777.692952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4778.454206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4779.246663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4780.084371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4781.123698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4781.994236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4782.886294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4783.832145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4784.718700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4785.720367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4786.663783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4787.765385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4788.552553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4789.356111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4790.181155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4791.177826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4791.962609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4792.951335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4793.751319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4794.596801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4795.298892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4796.100686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4796.851142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4797.805889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4798.664632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4799.479166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.224667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.974398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4801.589086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4802.376099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4803.197555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.049895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.819213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4805.493386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4806.277698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.055350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.880916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4808.669568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4809.472310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.377666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4811.242816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4812.078505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4812.973376] LustreError: 162734:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4812.983260] LustreError: 162734:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4812.987176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.662457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.488446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.287686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4816.148283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.049395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.053489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.251514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.163056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.197388] LustreError: 162734:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4821.214414] LustreError: 162734:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4821.219296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.199638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.193399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4824.154883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.171866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.041645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.992178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.913721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.744313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.503491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.365131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.303172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.098989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.037969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.162626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.008851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.188300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.999739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.849995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.792478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.625628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.540817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.428747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.307603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.407915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.351024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.400863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.202492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.393621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.233350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.064271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.877228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.791995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.718863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.674983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.460280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.274755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4855.116426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.094023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.014926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.027556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.006223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.970866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.733669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.604184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.433877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.320485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.163631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.152903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.034847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.880577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.730330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.588370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.284782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.047721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.853372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.662085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.394355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.165601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.975897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.868029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.666824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.568181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.475867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.417355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.128648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.123726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.928585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.864121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.677320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.568244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.420763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.215037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.967824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.677889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.517251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.269114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.091726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.137057] LustreError: 164311:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 5335.152513] LustreError: 162734:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6000.101973] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6000.108289] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6000.127103] Lustre: Skipped 364 previous similar messages [ 6000.139275] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6005.627956] LustreError: 216694:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6005.737656] LustreError: 216440:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6005.754725] LustreError: 216440:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6005.838203] Lustre: server umount lustre-OST0000 complete [ 6010.852392] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6010.854326] Lustre: Skipped 1 previous similar message [ 6015.168758] LustreError: 216897:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6015.171490] LustreError: 216897:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6015.396672] Lustre: server umount lustre-MDT0000 complete [ 6015.972089] LustreError: 163426:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6015.990394] LustreError: 163426:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6018.821081] LustreError: 206462:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351712 with bad export cookie 15155141632288557753 [ 6018.824508] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6018.866927] LustreError: 206462:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6019.052107] LustreError: 217099:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6019.065833] LustreError: 217099:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6019.275188] Lustre: server umount lustre-MDT0001 complete [ 6028.545621] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6030.887055] Key type lgssc unregistered [ 6031.120986] LNet: 217631:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6031.135850] LNetError: 217631:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6031.250089] LNet: Removed LNI 192.168.204.125@tcp [ 6032.011722] Key type .llcrypt unregistered [ 6032.013387] Key type ._llcrypt unregistered [ 6053.565760] Key type ._llcrypt registered [ 6053.567302] Key type .llcrypt registered [ 6053.648089] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6054.342713] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6054.428838] alg: No test for adler32 (adler32-zlib) [ 6055.421760] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 6055.548561] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6057.192814] Key type lgssc registered [ 6058.175967] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6064.662315] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6064.676073] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6066.125956] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6069.677991] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6076.390453] LustreError: 219025:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6076.407460] LustreError: 219025:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6077.513634] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6077.977948] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6081.078970] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6085.416187] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6088.773535] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6094.750692] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6095.137628] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6100.456190] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6105.536794] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6111.569329] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 6119.878185] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6121.212339] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6121.230256] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6121.243371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.251791] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6121.252201] LustreError: 219045:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6124.003225] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6124.008053] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6124.022582] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6126.416153] Lustre: lustre-OST0000: Not available for connect from 192.168.204.25@tcp (stopping) [ 6127.078043] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6131.520419] Lustre: lustre-OST0000: Not available for connect from 192.168.204.25@tcp (stopping) [ 6131.528265] Lustre: Skipped 2 previous similar messages [ 6136.640033] Lustre: lustre-OST0000: Not available for connect from 192.168.204.25@tcp (stopping) [ 6136.650101] Lustre: Skipped 2 previous similar messages [ 6137.318135] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6137.379955] LustreError: 221444:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6137.508971] Lustre: server umount lustre-OST0000 complete [ 6141.351158] LustreError: 219045:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6169.884459] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6170.180242] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6174.211411] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6178.943831] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6192.681436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6192.706578] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6192.711822] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6193.688436] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 12 sec [ 6196.406381] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a4643e70000.ost_server_uuid 50 [ 6197.664506] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a4643e70000.ost_server_uuid in FULL state after 0 sec [ 6202.850777] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6202.857947] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6202.860177] Lustre: Skipped 2 previous similar messages [ 6206.325144] LustreError: 222787:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6206.334927] LustreError: 222787:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6206.412540] Lustre: server umount lustre-OST0000 complete [ 6211.041818] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6211.046641] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6211.059275] Lustre: Skipped 1 previous similar message [ 6211.064212] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6223.327272] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6223.382949] LustreError: 222988:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6223.387576] LustreError: 222988:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6223.466387] Lustre: server umount lustre-MDT0000 complete [ 6226.086436] LustreError: 219006:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351919 with bad export cookie 3217773081411881200 [ 6226.094604] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6226.099589] LustreError: 219006:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6226.206312] LustreError: 223190:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6226.208972] LustreError: 223190:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6226.378855] Lustre: server umount lustre-MDT0001 complete [ 6233.850258] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6235.793515] Key type lgssc unregistered [ 6236.012680] LNet: 223723:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6236.030748] LNetError: 223723:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6236.049870] LNet: Removed LNI 192.168.204.125@tcp [ 6236.740645] Key type .llcrypt unregistered [ 6236.743118] Key type ._llcrypt unregistered [ 6259.351961] Key type ._llcrypt registered [ 6259.354532] Key type .llcrypt registered [ 6259.427279] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6260.087187] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6260.121507] alg: No test for adler32 (adler32-zlib) [ 6261.153493] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 6261.310910] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6262.959211] Key type lgssc registered [ 6263.822730] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6271.937722] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6271.956703] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6273.305532] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6276.232825] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6282.533339] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6282.759333] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6285.675569] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6287.712478] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6292.830782] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6292.965626] LustreError: 226865:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6292.989201] LustreError: 226865:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6293.105560] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6297.477249] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6299.414700] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 6304.485967] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6304.561195] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6304.721501] Lustre: lustre-OST0001: new disk, initializing [ 6304.727711] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6304.831714] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6309.157458] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6314.558952] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6314.565099] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6314.675815] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6317.496953] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6325.185770] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 6342.990987] LustreError: 228766:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 6343.044678] Lustre: server umount lustre-MDT0000 complete [ 6343.143928] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [ 6343.148120] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6343.155940] LustreError: 225412:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6345.413481] LustreError: 226512:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352039 with bad export cookie 17526376167870193488 [ 6345.416888] LustreError: 226512:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6345.417523] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6345.437540] LustreError: 226132:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 6345.442703] LustreError: 226132:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff908e29330000 x1849008538608000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 [ 6345.551193] LustreError: 228968:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 6345.553334] LustreError: 228968:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6345.650667] Lustre: server umount lustre-MDT0001 complete [ 6362.207494] Lustre: 224672:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763352039/real 1763352039] req@ffff908e11dda300 x1849008538608768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1763352055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6362.234863] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6367.263177] Lustre: 224675:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763352044/real 1763352044] req@ffff908e0619ad80 x1849008538609152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1763352060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6367.283396] Lustre: 224675:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 6367.458557] LustreError: 229168:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6367.465819] LustreError: 229168:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6367.510155] Lustre: server umount lustre-OST0000 complete [ 6370.643239] LustreError: 229383:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 6370.645201] LustreError: 229383:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6370.785331] Lustre: server umount lustre-OST0001 complete [ 6373.201920] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6373.255396] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6374.082062] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6374.164731] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6375.007501] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6375.088564] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6375.860106] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6375.957528] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6384.869904] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6392.038912] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6392.316421] LustreError: 230793:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6392.391303] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6394.685310] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6397.415090] LustreError: 230793:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6400.225929] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6400.515959] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6403.279321] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6405.422147] Lustre: 231904:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6410.042908] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6411.308551] LustreError: 232260:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6411.335332] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 6414.390123] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6417.391354] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49761) [ 6420.398065] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6420.598554] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6420.603506] Lustre: Skipped 1 previous similar message [ 6421.916131] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 6424.961443] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6430.357299] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6432.640266] Lustre: 233750:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6446.564885] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6446.566671] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6446.567531] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6446.572767] Lustre: Skipped 3 previous similar messages [ 6446.938935] LustreError: 234059:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 6446.943269] LustreError: 234059:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6447.020415] Lustre: server umount mylustre-MDT0000 complete [ 6449.401553] LustreError: 233951:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352143 with bad export cookie 17526376167870196337 [ 6449.403811] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6449.405992] LustreError: 233951:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6449.651366] Lustre: server umount mylustre-MDT0001 complete [ 6462.656467] LustreError: 234461:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 6462.658520] LustreError: 234461:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 6462.693458] Lustre: server umount mylustre-OST0000 complete [ 6474.659659] Lustre: server umount mylustre-OST0001 complete [ 6476.753109] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6476.815184] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6477.579484] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6477.634113] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6478.410818] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6478.468792] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6479.213554] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6479.304545] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6489.097700] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6495.224754] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6495.583283] LustreError: 236071:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6495.599973] LustreError: 236071:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6495.671877] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6498.444494] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6504.922243] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6507.801541] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6510.039657] Lustre: 237181:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6514.723786] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6516.075174] LustreError: 237641:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6516.083152] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 6516.086690] LustreError: 237641:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6518.780447] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6521.196620] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49793) [ 6523.760597] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6525.890035] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 6526.952183] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6532.150457] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6534.570799] Lustre: 239026:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6544.358511] Lustre: tfs-MDT0000-lwp-OST0000: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6544.360457] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 6544.367928] Lustre: Skipped 2 previous similar messages [ 6544.370042] Lustre: Skipped 3 previous similar messages [ 6549.475777] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 6549.478597] Lustre: Skipped 6 previous similar messages [ 6550.423255] LustreError: 239278:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 6550.426606] LustreError: 239278:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6550.510908] Lustre: server umount tfs-MDT0000 complete [ 6552.996782] LustreError: 236045:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352246 with bad export cookie 17526376167870198514 [ 6552.999039] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6553.004427] LustreError: 236045:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6553.209185] Lustre: server umount tfs-MDT0001 complete [ 6566.070544] Lustre: server umount tfs-OST0000 complete [ 6577.699482] Lustre: server umount tfs-OST0001 complete [ 6579.726911] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6579.811502] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6580.558026] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6580.621141] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6581.299140] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6581.359871] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6582.084373] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6582.145740] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6590.260868] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6595.680177] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6595.970469] LustreError: 241290:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6595.984481] LustreError: 241290:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6596.036691] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6596.039935] Lustre: Skipped 3 previous similar messages [ 6598.262500] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6603.005851] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6605.428826] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6606.996479] Lustre: 242398:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6610.442428] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6612.716954] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 6613.782616] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6619.247353] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6620.405114] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49825) [ 6620.413838] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 6622.992809] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6628.128255] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6630.111989] Lustre: 244250:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6638.345642] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 23:05:30 (1763352330) [ 6654.433147] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6654.433933] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6654.437180] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6654.445874] Lustre: Skipped 5 previous similar messages [ 6657.162525] LustreError: 244619:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 6657.164561] LustreError: 244619:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 6657.222554] Lustre: server umount lustre-MDT0000 complete [ 6658.948595] LustreError: 241265:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352352 with bad export cookie 17526376167870200432 [ 6658.950763] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6658.954051] LustreError: 241265:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6659.553601] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6659.556553] Lustre: Skipped 4 previous similar messages [ 6663.584939] LustreError: 241286:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6663.592257] LustreError: 241286:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 6668.704935] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6668.707259] Lustre: Skipped 3 previous similar messages [ 6673.375132] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6673.498417] Lustre: server umount lustre-MDT0001 complete [ 6690.271919] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6690.332213] Lustre: server umount lustre-OST0000 complete [ 6707.167176] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6707.276266] Lustre: server umount lustre-OST0001 complete [ 6710.414386] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 6715.705309] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6722.060053] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6725.801476] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6729.517379] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6733.760662] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6737.751577] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6737.784639] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 6737.784639] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 6737.784639] [ 6737.803752] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 6737.955988] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6737.978326] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6738.021519] Lustre: lustre-MDT0000: new disk, initializing [ 6738.079157] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6738.082032] Lustre: Skipped 3 previous similar messages [ 6738.091249] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6740.044288] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6746.192682] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6746.228465] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6746.284796] Lustre: 247412:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6746.326529] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6746.329620] Lustre: Skipped 1 previous similar message [ 6746.374102] Lustre: lustre-MDT0001: new disk, initializing [ 6746.453485] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6746.460082] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6748.571473] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6755.457794] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6755.498570] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6755.652908] Lustre: lustre-OST0000: new disk, initializing [ 6755.658689] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6756.960397] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6756.967854] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6757.055811] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6759.060816] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6765.651881] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6765.710765] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6765.793344] Lustre: lustre-OST0001: new disk, initializing [ 6765.796591] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6767.775768] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6767.783474] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6767.827889] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6768.736547] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6775.062313] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 23:07:47 (1763352467) [ 6781.594093] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 23:07:53 (1763352473) [ 6798.325626] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6798.326763] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6798.328135] LustreError: Skipped 1 previous similar message [ 6798.338883] Lustre: Skipped 2 previous similar messages [ 6798.341573] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6798.347218] Lustre: Skipped 1 previous similar message [ 6799.998085] LustreError: 250834:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 6800.000871] LustreError: 250834:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 6800.036446] Lustre: server umount lustre-OST0000 complete [ 6802.912975] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6803.939695] LustreError: 249106:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6803.947618] LustreError: 249106:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6808.324575] Lustre: server umount lustre-MDT0000 complete [ 6810.093156] LustreError: 247404:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352503 with bad export cookie 17526376167870202210 [ 6810.094963] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6810.099354] LustreError: 247404:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6816.341194] Lustre: server umount lustre-MDT0001 complete [ 6821.070095] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6833.865771] Lustre: server umount lustre-OST0001 complete [ 6837.275534] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 6845.643924] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6851.367480] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6854.625474] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6857.762783] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6860.949653] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6864.496416] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6864.538387] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6864.671308] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6864.696428] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6864.748789] Lustre: lustre-MDT0000: new disk, initializing [ 6864.832183] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6867.046857] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6873.809361] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6873.843564] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6873.896893] Lustre: 254291:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6874.045506] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6876.010221] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6880.381091] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6882.174483] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6885.422462] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6885.467045] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6885.600962] Lustre: lustre-OST0000: new disk, initializing [ 6885.603968] Lustre: Skipped 1 previous similar message [ 6885.607295] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6885.610191] Lustre: Skipped 2 previous similar messages [ 6887.056683] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6887.061264] Lustre: Skipped 1 previous similar message [ 6887.063727] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6887.106672] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6888.806531] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6893.317740] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6897.634591] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6897.637966] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6897.645697] Lustre: Skipped 5 previous similar messages [ 6897.649129] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6897.652264] Lustre: Skipped 7 previous similar messages [ 6903.099672] Lustre: server umount lustre-OST0000 complete [ 6911.247784] Lustre: server umount lustre-MDT0000 complete [ 6913.324181] LustreError: 254283:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352606 with bad export cookie 17526376167870203680 [ 6913.331073] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6913.333825] LustreError: 254283:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6913.525177] Lustre: server umount lustre-MDT0001 complete [ 6919.025775] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6920.511744] Key type lgssc unregistered [ 6920.689474] LNet: 257667:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6920.692700] LNetError: 257667:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6920.705227] LNet: Removed LNI 192.168.204.125@tcp [ 6921.156182] Key type .llcrypt unregistered [ 6921.157987] Key type ._llcrypt unregistered [ 6934.558159] Key type ._llcrypt registered [ 6934.559801] Key type .llcrypt registered [ 6934.608749] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6935.017397] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6935.048938] alg: No test for adler32 (adler32-zlib) [ 6935.961983] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 6936.081984] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6937.671185] Key type lgssc registered [ 6938.218936] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6942.347872] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6942.359250] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6943.611453] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6945.807950] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6950.773813] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6950.992626] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6953.079585] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6956.105383] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6958.221849] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6962.316805] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6962.525357] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6965.493671] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6968.506338] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6968.681602] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 6968.991505] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 6973.921827] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6973.925377] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6973.935753] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6975.973742] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6975.980771] Lustre: Skipped 1 previous similar message [ 6976.054088] LustreError: 261383:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6976.130848] Lustre: server umount lustre-OST0000 complete [ 6981.089283] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6981.091689] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6981.096988] Lustre: Skipped 1 previous similar message [ 6981.102292] Lustre: Skipped 1 previous similar message [ 6984.388775] LustreError: 261589:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6984.394645] LustreError: 261589:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6984.431737] Lustre: server umount lustre-MDT0000 complete [ 6986.209456] LustreError: 260142:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6986.220742] LustreError: 260142:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6986.537306] LustreError: 259069:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352680 with bad export cookie 287369018758579132 [ 6986.539035] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6986.543631] LustreError: 259069:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6986.649593] LustreError: 261790:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6986.652622] LustreError: 261790:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6986.809216] Lustre: server umount lustre-MDT0001 complete [ 6991.829781] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6993.184531] Key type lgssc unregistered [ 6993.347703] LNet: 262321:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6993.351256] LNetError: 262321:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6993.362544] LNet: Removed LNI 192.168.204.125@tcp [ 6993.753472] Key type .llcrypt unregistered [ 6993.754709] Key type ._llcrypt unregistered [ 7003.075725] Key type ._llcrypt registered [ 7003.077428] Key type .llcrypt registered [ 7003.129577] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7003.524548] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7003.568648] alg: No test for adler32 (adler32-zlib) [ 7004.483623] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 7004.589807] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 7006.207167] Key type lgssc registered [ 7006.766097] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7011.989088] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7012.000035] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7027.487444] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7032.607231] LustreError: 263475:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.125@tcp: failed processing log, type 4: rc = -110 [ 7059.231204] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7062.132772] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7064.888832] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7066.019599] LustreError: 264138:0:(obd_class.h:479:obd_check_dev()) Device 1 not setup [ 7066.079529] Lustre: server umount lustre-OST0000 complete [ 7074.559330] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 7076.046032] Key type lgssc unregistered [ 7076.281939] LNet: 264973:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7076.289524] LNetError: 264973:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7076.301505] LNet: Removed LNI 192.168.204.125@tcp [ 7076.738106] Key type .llcrypt unregistered [ 7076.739560] Key type ._llcrypt unregistered [ 7101.105498] Key type ._llcrypt registered [ 7101.111106] Key type .llcrypt registered [ 7101.182030] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7101.628162] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7101.691399] alg: No test for adler32 (adler32-zlib) [ 7102.595397] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 7102.740142] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 7104.367811] Key type lgssc registered [ 7104.976770] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7111.896239] loop0: detected capacity change from 0 to 204800000 [ 7111.992207] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7111.998175] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7112.169591] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7112.200409] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7112.683323] loop0: detected capacity change from 0 to 204800000 [ 7112.761423] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7112.767446] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7112.934020] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7112.965794] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7113.429577] loop0: detected capacity change from 0 to 204800000 [ 7113.506884] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7113.512703] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7113.568285] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7113.630789] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7114.137744] loop0: detected capacity change from 0 to 204800000 [ 7114.232228] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7114.366758] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7114.907214] loop0: detected capacity change from 0 to 204800000 [ 7114.919536] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7116.763812] loop0: detected capacity change from 0 to 204800000 [ 7116.785182] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7118.502499] loop0: detected capacity change from 0 to 204800000 [ 7118.517918] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7120.353661] loop0: detected capacity change from 0 to 204800000 [ 7120.371911] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7122.268455] loop0: detected capacity change from 0 to 204800000 [ 7122.356603] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7122.385996] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7122.405318] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7122.439672] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7122.444860] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 7122.449838] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 7122.455613] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 7122.459908] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7122.466232] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7122.471228] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7122.476730] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 7122.481953] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 7122.486769] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 7122.492517] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 7122.497740] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 7122.503338] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 7122.509573] Lustre: 268349:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 7126.201135] LustreError: 268616:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7126.296559] Lustre: server umount MGS complete [ 7126.795070] loop0: detected capacity change from 0 to 204800000 [ 7126.853971] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7127.119352] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7127.150685] Lustre: lustre-MDT0000: Aborting client recovery [ 7127.689381] loop1: detected capacity change from 0 to 204800000 [ 7127.753478] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7127.795770] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7127.822642] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7127.829887] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7127.835624] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7127.842040] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7127.848235] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 7127.853800] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 7127.859803] Lustre: 268785:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 7127.872103] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7127.983139] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7128.020785] Lustre: lustre-MDT0001: Aborting client recovery [ 7128.473955] loop2: detected capacity change from 0 to 204800000 [ 7128.561499] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7128.601459] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7128.622772] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7128.628600] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7128.634971] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7128.644596] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7128.650312] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7128.657471] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7128.663271] Lustre: 268869:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7128.741194] Lustre: Found index 0 for lustre-OST0000, updating log [ 7128.829514] Lustre: lustre-OST0000: Aborting recovery [ 7129.279294] loop3: detected capacity change from 0 to 204800000 [ 7129.349779] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7129.381743] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7129.408885] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7129.414847] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7129.419837] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7129.425416] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7129.431341] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7129.438226] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7129.445227] Lustre: 268958:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7129.504171] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7129.507630] Lustre: Skipped 1 previous similar message [ 7129.516364] Lustre: lustre-OST0001: Aborting recovery [ 7134.711448] LustreError: 268728:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 7136.740922] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7136.743614] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7136.762995] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 7136.776248] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 7137.765438] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 7137.765511] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 7140.656946] LustreError: 268696:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 562us: rc = -2 [ 7153.120119] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7153.121797] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7153.126315] Lustre: Skipped 2 previous similar messages [ 7153.130552] Lustre: Skipped 3 previous similar messages [ 7158.240030] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7158.243683] Lustre: Skipped 3 previous similar messages [ 7158.295210] LustreError: 269313:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 7158.298167] LustreError: 269313:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 7158.365567] Lustre: server umount lustre-MDT0000 complete [ 7158.821825] LustreError: 268679:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352852 with bad export cookie 17617938357552390877 [ 7158.828173] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7163.359960] LustreError: 268694:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7163.360081] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7163.360839] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7163.368125] LustreError: 268694:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7163.373453] Lustre: Skipped 2 previous similar messages [ 7165.018449] LustreError: 269364:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 7165.021143] LustreError: 269364:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7165.140478] Lustre: server umount lustre-MDT0001 complete [ 7171.694514] LustreError: 269417:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 7171.697593] LustreError: 269417:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7171.734265] Lustre: server umount lustre-OST0000 complete [ 7178.223455] LustreError: 269468:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7178.227322] LustreError: 269468:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7178.308479] Lustre: server umount lustre-OST0001 complete [ 7182.628569] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 23:14:34 (1763352874) [ 7197.138146] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 7201.866876] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7206.985771] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7210.213940] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7213.100494] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7216.119713] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7219.469299] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7219.503770] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7219.609303] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7219.630937] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7219.676479] Lustre: lustre-MDT0000: new disk, initializing [ 7219.727514] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7219.737922] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7221.563581] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7227.407954] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7227.435530] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7227.488031] Lustre: 273014:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7227.539676] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7227.542523] Lustre: Skipped 1 previous similar message [ 7227.592709] Lustre: lustre-MDT0001: new disk, initializing [ 7227.647327] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7227.671425] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7227.678699] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7229.446714] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7233.792242] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7235.675255] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7239.016975] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7239.064475] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7239.205573] Lustre: lustre-OST0000: new disk, initializing [ 7239.214170] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7239.263740] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7241.351442] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7241.355979] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7241.408726] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7241.945722] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7245.786723] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7248.608268] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 7251.599656] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 7258.107159] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 7265.016180] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 7298.019202] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7298.020859] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7298.022584] LustreError: Skipped 1 previous similar message [ 7298.023250] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7298.030351] Lustre: Skipped 1 previous similar message [ 7298.033050] Lustre: Skipped 1 previous similar message [ 7303.139742] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7303.142245] Lustre: Skipped 1 previous similar message [ 7310.303207] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7310.330600] LustreError: 276481:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7310.336195] LustreError: 276481:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 7310.403982] Lustre: server umount lustre-OST0000 complete [ 7313.379170] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7313.387536] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7313.390045] Lustre: Skipped 3 previous similar messages [ 7318.496739] LustreError: 273021:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7318.498345] Lustre: server umount lustre-MDT0000 complete [ 7318.501974] LustreError: 273021:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7320.224383] LustreError: 275504:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353013 with bad export cookie 17617938357552393586 [ 7320.227445] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7320.228739] LustreError: 275504:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 7320.409191] Lustre: server umount lustre-MDT0001 complete [ 7324.209057] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7325.896821] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7328.150420] LustreError: 277827:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7328.152802] LustreError: 277827:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 7328.193649] Lustre: server umount MGS complete [ 7333.684451] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7333.947509] LustreError: 278451:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7333.966097] LustreError: 278463:0:(qmt_pool.c:1523:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 7334.003144] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7335.782594] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7339.489674] LustreError: 278451:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7339.704655] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7341.871648] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7344.563986] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7346.179775] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7349.105489] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7351.869399] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7354.458863] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7373.794360] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7373.794811] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7373.798973] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7373.803450] Lustre: Skipped 2 previous similar messages [ 7378.923926] LustreError: 281107:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 7378.926023] LustreError: 281107:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 7378.971301] Lustre: server umount lustre-OST0000 complete [ 7380.960557] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7384.033421] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7384.039507] Lustre: Skipped 1 previous similar message [ 7386.785409] Lustre: server umount lustre-MDT0000 complete [ 7388.298613] LustreError: 278430:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353081 with bad export cookie 17617938357552395427 [ 7388.302302] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7388.303876] LustreError: 278430:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7388.453220] Lustre: server umount lustre-MDT0001 complete [ 7393.053446] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 7394.308868] Key type lgssc unregistered [ 7394.449752] LNet: 282042:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7394.453051] LNetError: 282042:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7394.466419] LNet: Removed LNI 192.168.204.125@tcp [ 7394.855611] Key type .llcrypt unregistered [ 7394.857460] Key type ._llcrypt unregistered [ 7412.629092] Key type ._llcrypt registered [ 7412.630888] Key type .llcrypt registered [ 7412.700627] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 7420.663786] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7421.121268] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7421.190389] alg: No test for adler32 (adler32-zlib) [ 7422.093853] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 7422.229755] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 7423.839877] Key type lgssc registered [ 7424.375499] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7429.141254] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7432.436922] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7435.619661] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7438.682598] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7441.839880] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7441.874738] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7441.882878] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7443.001177] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7443.019239] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7443.062316] Lustre: lustre-MDT0000: new disk, initializing [ 7443.110331] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7443.122129] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7444.863559] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7450.398268] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7450.430523] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7450.475664] Lustre: 285948:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7450.515255] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7450.517934] Lustre: Skipped 1 previous similar message [ 7450.558646] Lustre: lustre-MDT0001: new disk, initializing [ 7450.604720] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7450.620657] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7450.625871] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7452.404419] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7456.385115] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7458.180595] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7461.587241] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7461.629018] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7461.769858] Lustre: lustre-OST0000: new disk, initializing [ 7461.772568] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7461.815150] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7464.498658] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7468.554941] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7470.079968] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7470.084394] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7470.131753] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7477.687641] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 7480.603114] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 7485.560114] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 7494.393474] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 7541.729094] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7541.730337] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7541.732038] LustreError: Skipped 1 previous similar message [ 7541.743377] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7541.747198] Lustre: Skipped 1 previous similar message [ 7543.538546] LustreError: 289374:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7543.596356] Lustre: server umount lustre-OST0000 complete [ 7546.849796] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7546.851213] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7546.855706] Lustre: Skipped 2 previous similar messages [ 7551.429519] LustreError: 289575:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 7551.431608] LustreError: 289575:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7551.482950] Lustre: server umount lustre-MDT0000 complete [ 7551.969117] LustreError: 287190:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7551.975755] LustreError: 287190:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7553.115294] LustreError: 288439:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353246 with bad export cookie 6969711891626870855 [ 7553.119208] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7553.120723] LustreError: 288439:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7553.193769] LustreError: 289776:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 7553.196065] LustreError: 289776:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 7553.273211] Lustre: server umount lustre-MDT0001 complete [ 7556.920044] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7558.576756] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7560.721436] LustreError: 290717:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7560.724229] LustreError: 290717:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7560.765770] Lustre: server umount MGS complete [ 7565.528688] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7565.751213] LustreError: 291340:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7565.767758] LustreError: 291352:0:(qmt_pool.c:1523:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 7565.808649] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7567.575749] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7570.913616] LustreError: 291340:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7571.503439] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7571.678846] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7573.445984] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7575.989376] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7577.690321] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7580.833636] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7581.004536] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7583.507175] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7585.812110] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7622.116405] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7622.121842] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7622.122877] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7622.127419] Lustre: Skipped 1 previous similar message [ 7623.278159] LustreError: 294022:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 7623.280643] LustreError: 294022:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 7623.324028] Lustre: server umount lustre-OST0000 complete [ 7626.985758] Lustre: server umount lustre-MDT0000 complete [ 7627.233987] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7627.235824] LustreError: 291339:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7627.240594] Lustre: Skipped 2 previous similar messages [ 7628.511292] LustreError: 291319:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353322 with bad export cookie 6969711891626872794 [ 7628.513920] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7628.516802] LustreError: 291319:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7628.650821] Lustre: server umount lustre-MDT0001 complete [ 7632.798477] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 7633.990621] Key type lgssc unregistered [ 7634.136740] LNet: 294956:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7634.140565] LNetError: 294956:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7634.148385] LNet: Removed LNI 192.168.204.125@tcp [ 7634.480921] Key type .llcrypt unregistered [ 7634.483090] Key type ._llcrypt unregistered [ 7642.735708] Key type ._llcrypt registered [ 7642.737304] Key type .llcrypt registered [ 7642.787123] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 7649.662585] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7650.200133] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7650.212720] alg: No test for adler32 (adler32-zlib) [ 7651.099358] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 7651.203855] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 7652.799427] Key type lgssc registered [ 7653.331750] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7657.295309] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7660.091499] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7663.920961] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7667.685452] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7670.784740] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7670.809682] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7670.820253] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7671.946562] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7671.964979] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7672.011361] Lustre: lustre-MDT0000: new disk, initializing [ 7672.065925] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7672.077315] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7673.764113] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7679.124971] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7679.154305] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7679.277221] Lustre: lustre-OST0000: new disk, initializing [ 7679.279287] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 7679.281567] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7679.286154] Lustre: Skipped 1 previous similar message [ 7679.315825] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7681.904362] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7684.606466] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 7684.610483] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 7684.624635] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 7991.776611] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7991.781366] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7996.896223] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7996.993577] LustreError: 299890:0:(obd_class.h:479:obd_check_dev()) Device 11 not setup [ 7997.131540] Lustre: server umount lustre-MDT0000 complete [ 7998.671351] LustreError: 298918:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353692 with bad export cookie 2326439253569385191 [ 7998.672848] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7998.676952] LustreError: 298918:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7998.702574] LustreError: 300093:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7998.705505] LustreError: 300093:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7998.759386] Lustre: server umount lustre-OST0000 complete [ 8008.909653] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 8013.114491] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8017.404887] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8020.030699] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8022.435125] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8024.867861] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8027.383954] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8027.404746] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8027.492239] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8027.505498] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8027.544526] Lustre: lustre-MDT0000: new disk, initializing [ 8027.573650] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8027.582313] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8029.136182] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8033.685742] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8033.711247] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8033.754479] Lustre: 303131:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8033.780279] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8033.783809] Lustre: Skipped 1 previous similar message [ 8033.825340] Lustre: lustre-MDT0001: new disk, initializing [ 8033.863339] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8033.877323] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8033.882178] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8035.361394] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8038.687247] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8039.981079] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8042.391347] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8042.416832] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8042.521177] Lustre: lustre-OST0000: new disk, initializing [ 8042.524104] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8042.557100] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8044.650791] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8047.989401] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8049.582360] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8050.685991] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8050.689932] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8050.729315] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8051.707991] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 8053.226760] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 8053.307976] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 8055.777986] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8055.779282] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8055.779931] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8055.780407] LustreError: Skipped 1 previous similar message [ 8055.787979] Lustre: Skipped 1 previous similar message [ 8060.082109] LustreError: 306081:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 8060.085216] LustreError: 306081:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8060.128233] Lustre: server umount lustre-OST0000 complete [ 8064.479822] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8064.482203] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8064.486109] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8064.488491] Lustre: Skipped 1 previous similar message [ 8067.714659] LustreError: 306282:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 8067.717361] LustreError: 306282:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8067.752437] Lustre: server umount lustre-MDT0000 complete [ 8069.081071] LustreError: 303124:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353762 with bad export cookie 2326439253572325982 [ 8069.083816] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8069.085765] LustreError: 303124:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8069.200056] Lustre: server umount lustre-MDT0001 complete [ 8070.460511] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 8071.112433] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 23:29:23 (1763353763) [ 8073.552883] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8073.737372] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8075.185868] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8078.210213] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8079.715185] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8081.458405] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8082.654121] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8085.032449] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8087.103674] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8089.052988] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8091.614681] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8091.646358] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8091.705753] Lustre: lustre-OST0001: new disk, initializing [ 8091.707754] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8091.738273] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8091.740873] Lustre: Skipped 2 previous similar messages [ 8093.850400] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8097.794595] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8097.798194] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8097.814524] LustreError: 310113:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 8098.850641] LustreError: 310119:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8098.855248] LustreError: 310119:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 8099.881333] LustreError: 310113:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 8099.887776] LustreError: 310113:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 8101.922962] LustreError: 310113:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 8101.926508] LustreError: 310113:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 8103.083875] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8103.151449] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8104.405909] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a4674dab800.ost_server_uuid 50 [ 8104.944153] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a4674dab800.ost_server_uuid in FULL state after 0 sec [ 8106.018430] LustreError: 310119:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8106.022869] LustreError: 310119:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 8106.206668] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8a4674dab800.ost_server_uuid 50 [ 8106.761128] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8a4674dab800.ost_server_uuid in FULL state after 0 sec [ 8108.073396] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8120.292791] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8120.293366] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 8120.296534] Lustre: Skipped 2 previous similar messages [ 8120.299490] Lustre: Skipped 3 previous similar messages [ 8124.589127] LustreError: 310859:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup [ 8124.591850] LustreError: 310859:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 8124.615400] Lustre: server umount lustre-OST0001 complete [ 8125.410960] LustreError: 308651:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8125.419962] LustreError: 308651:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8129.504559] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8129.507425] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8130.532558] LustreError: 310121:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8130.539107] LustreError: 310121:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8132.369414] Lustre: server umount lustre-OST0000 complete [ 8134.623734] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8134.626375] LustreError: Skipped 1 previous similar message [ 8139.836786] LustreError: 311261:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 8139.839733] LustreError: 311261:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8139.864778] Lustre: server umount lustre-MDT0000 complete [ 8140.768943] LustreError: 307766:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8140.775041] LustreError: 307766:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8141.204432] LustreError: 307035:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353834 with bad export cookie 2326439253572326843 [ 8141.207815] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8141.209469] LustreError: 307035:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8141.332760] Lustre: server umount lustre-MDT0001 complete [ 8145.191707] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 8146.313334] Key type lgssc unregistered [ 8146.450407] LNet: 311993:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8146.454424] LNetError: 311993:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8146.463458] LNet: Removed LNI 192.168.204.125@tcp [ 8146.794099] Key type .llcrypt unregistered [ 8146.795587] Key type ._llcrypt unregistered [ 8156.545273] Key type ._llcrypt registered [ 8156.546880] Key type .llcrypt registered [ 8156.595714] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8156.934942] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8156.977138] alg: No test for adler32 (adler32-zlib) [ 8157.842784] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 8157.932840] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 8159.511164] Key type lgssc registered [ 8159.893210] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8162.655111] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8162.661787] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8163.824667] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8165.178726] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8166.994491] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8169.358565] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8169.504535] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8170.975293] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8174.315776] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8174.434774] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8176.332869] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8178.244228] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8179.556297] LustreError: 314924:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8179.563114] LustreError: 314924:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8180.724575] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8180.811684] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8182.854468] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8184.772843] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 8188.914146] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 8188.914618] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 8191.722126] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 8191.812867] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 8270.824259] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8270.831277] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 8270.831483] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8270.834537] Lustre: Skipped 1 previous similar message [ 8275.436077] LustreError: 316793:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 8275.451211] Lustre: server umount lustre-OST0001 complete [ 8275.937715] LustreError: 316371:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8275.941512] LustreError: 316371:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8281.060251] LustreError: 314924:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8281.060798] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8281.063100] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8281.065630] LustreError: 314924:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8281.066704] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8281.069288] Lustre: Skipped 2 previous similar messages [ 8286.179581] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8286.180485] LustreError: 314923:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8286.182713] Lustre: Skipped 2 previous similar messages [ 8286.192045] LustreError: 314923:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8291.295277] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8291.298870] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8291.304721] LustreError: 316371:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8291.309900] LustreError: 316371:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8291.322205] LustreError: 316995:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 8291.323785] LustreError: 316995:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8291.380038] Lustre: server umount lustre-OST0000 complete [ 8296.416864] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8296.417615] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8296.421175] Lustre: Skipped 1 previous similar message [ 8296.423875] Lustre: Skipped 1 previous similar message [ 8306.656527] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8306.659574] Lustre: Skipped 3 previous similar messages [ 8307.167172] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8307.208673] LustreError: 317198:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 8307.211332] LustreError: 317198:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8307.245814] Lustre: server umount lustre-MDT0000 complete [ 8308.654492] LustreError: 313352:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763354002 with bad export cookie 18408290679203005197 [ 8308.656760] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8308.658316] LustreError: 313352:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8308.805341] Lustre: server umount lustre-MDT0001 complete [ 8312.599230] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 8313.881370] Key type lgssc unregistered [ 8314.036409] LNet: 317933:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8314.039845] LNetError: 317933:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8314.051428] LNet: Removed LNI 192.168.204.125@tcp [ 8314.413353] Key type .llcrypt unregistered [ 8314.414762] Key type ._llcrypt unregistered [ 8332.902435] Key type ._llcrypt registered [ 8332.903769] Key type .llcrypt registered [ 8332.942796] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8333.471674] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8333.482061] alg: No test for adler32 (adler32-zlib) [ 8334.357888] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 8334.456165] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 8336.031187] Key type lgssc registered [ 8336.406488] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8339.407375] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8339.413928] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8340.596681] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8342.033797] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8345.076602] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8345.218961] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8346.603721] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8347.622270] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8349.969769] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8350.104900] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8351.140535] LustreError: 321822:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8351.143665] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 8351.146775] LustreError: 321822:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8352.033077] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8355.097042] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8355.181691] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8356.211882] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 8357.138280] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8361.280559] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8366.978214] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8376.287906] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8376.291072] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8376.296079] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8376.804286] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8376.807160] Lustre: Skipped 2 previous similar messages [ 8376.807542] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8376.810494] Lustre: Skipped 2 previous similar messages [ 8381.501949] LustreError: 323592:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 8381.527417] Lustre: server umount lustre-MDT0000 complete [ 8381.921843] LustreError: 320180:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8381.928509] LustreError: 320180:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8382.828111] LustreError: 320159:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763354076 with bad export cookie 11083742263486369893 [ 8382.833214] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8382.905827] LustreError: 323793:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 8382.908418] LustreError: 323793:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8382.968684] Lustre: server umount lustre-MDT0001 complete [ 8394.228134] LustreError: 323993:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 8394.231319] LustreError: 323993:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8394.251725] Lustre: server umount lustre-OST0000 complete [ 8405.938777] LustreError: 324195:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 8405.940617] LustreError: 324195:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8405.991436] Lustre: server umount lustre-OST0001 complete [ 8411.763564] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8415.773061] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8415.936437] LustreError: 325371:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8415.954963] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8417.278468] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8420.238691] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8421.748369] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8422.838192] Lustre: 326480:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8425.168940] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8425.305154] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8425.306853] Lustre: Skipped 1 previous similar message [ 8426.340076] LustreError: 326839:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8426.346816] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 8427.235552] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8430.216951] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8431.670819] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 8432.466782] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8435.704703] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8436.984368] Lustre: 328328:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8445.921449] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8445.923410] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8445.925192] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8445.928614] Lustre: Skipped 3 previous similar messages [ 8445.930872] Lustre: Skipped 2 previous similar messages [ 8449.026095] LustreError: 328431:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 8449.028072] LustreError: 328431:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 8449.058320] Lustre: server umount lustre-MDT0000 complete [ 8450.261739] LustreError: 325350:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763354143 with bad export cookie 11083742263486371552 [ 8450.264898] LustreError: 325350:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8450.266768] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8450.382660] Lustre: server umount lustre-MDT0001 complete [ 8461.879119] LustreError: 328833:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 8461.881852] LustreError: 328833:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 8461.903500] Lustre: server umount lustre-OST0000 complete [ 8472.484576] Lustre: server umount lustre-OST0001 complete [ 8473.701075] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 8474.223604] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 8474.830436] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 23:36:07 (1763354167) [ 8482.274357] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8485.549792] loop0: detected capacity change from 0 to 1099511627776 [ 8485.703627] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 8485.706178] *** VALIDATE xfs *** [ 8485.712982] XFS (loop0): Mounting V5 Filesystem [ 8485.723274] XFS (loop0): Ending clean mount [ 8486.139319] loop1: detected capacity change from 0 to 18691697672192 [ 8501.036170] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8506.861659] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 8510.271351] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8513.710479] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8515.978220] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8518.128196] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8520.418201] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8522.798524] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8522.824781] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8522.949376] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8522.964450] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8522.999212] Lustre: lustre-MDT0000: new disk, initializing [ 8523.025871] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8523.028455] Lustre: Skipped 1 previous similar message [ 8523.034972] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8524.386347] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8528.675737] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8528.700690] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8528.737544] Lustre: 333402:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8528.760686] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8528.763156] Lustre: Skipped 1 previous similar message [ 8528.801476] Lustre: lustre-MDT0001: new disk, initializing [ 8528.847527] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8528.850830] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8530.240865] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8533.370362] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8534.581963] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8536.978085] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8537.001430] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8537.108848] Lustre: lustre-OST0000: new disk, initializing [ 8537.111787] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8538.622047] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8538.626057] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8538.662875] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8539.229573] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8542.451579] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8543.884376] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8543.955770] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8545.309889] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 8545.386375] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 8548.833055] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8548.833688] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8548.835156] LustreError: Skipped 1 previous similar message [ 8548.839575] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8548.841657] Lustre: Skipped 2 previous similar messages [ 8552.109184] LustreError: 336338:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 8552.110831] LustreError: 336338:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 8552.145561] Lustre: server umount lustre-OST0000 complete [ 8553.952857] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8553.953441] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8553.956973] Lustre: Skipped 2 previous similar messages [ 8559.515934] Lustre: server umount lustre-MDT0000 complete [ 8560.806105] LustreError: 333393:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763354254 with bad export cookie 11083742263486373106 [ 8560.810143] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8560.810572] LustreError: 333393:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 8560.931620] Lustre: server umount lustre-MDT0001 complete [ 8563.662948] XFS (loop0): Unmounting Filesystem [ 8565.316207] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 23:37:38 (1763354258) [ 8567.611704] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8567.767270] LustreError: 337557:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8567.774088] LustreError: 337557:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8567.793739] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8567.796698] Lustre: Skipped 2 previous similar messages [ 8569.099293] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8572.095642] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8573.667948] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8575.593350] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8576.899335] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8579.314788] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8581.341660] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8583.056276] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8596.959844] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8596.962692] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8596.966938] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8596.969035] Lustre: Skipped 3 previous similar messages [ 8602.862077] LustreError: 339919:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8602.863881] LustreError: 339919:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 8602.903146] Lustre: server umount lustre-OST0000 complete [ 8608.225472] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8608.228243] LustreError: Skipped 1 previous similar message [ 8610.264538] Lustre: server umount lustre-MDT0000 complete [ 8611.546283] LustreError: 338275:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763354305 with bad export cookie 11083742263486373988 [ 8611.549087] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8611.551019] LustreError: 338275:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8611.659606] Lustre: server umount lustre-MDT0001 complete [ 8614.956424] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 8616.042098] Key type lgssc unregistered [ 8616.176516] LNet: 340854:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8616.179887] LNetError: 340854:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8616.187523] LNet: Removed LNI 192.168.204.125@tcp [ 8616.534110] Key type .llcrypt unregistered [ 8616.535056] Key type ._llcrypt unregistered [ 8626.978163] Key type ._llcrypt registered [ 8626.979221] Key type .llcrypt registered [ 8627.024124] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8627.483234] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8627.496332] alg: No test for adler32 (adler32-zlib) [ 8628.365252] Lustre: Lustre: Build Version: 2.16.61_45_g58940e0 [ 8628.462169] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 8630.047098] Key type lgssc registered [ 8630.443684] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8633.367453] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8633.372761] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8634.550892] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8635.876544] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8638.815440] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8638.938405] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8640.186196] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8641.930243] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8643.093818] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8645.330000] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8645.429639] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8647.230750] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8649.077104] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8664.544220] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8664.546368] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8664.551245] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8665.057244] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8665.059073] Lustre: Skipped 1 previous similar message [ 8665.059688] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8668.412135] LustreError: 344695:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 8668.435051] Lustre: server umount lustre-MDT0001 complete [ 8669.385457] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8670.006961] LustreError: 342374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8670.011959] LustreError: 342374:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8671.985717] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8672.031073] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8672.033172] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8672.047447] Lustre: 342367:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8672.174645] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8673.579208] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8677.354091] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8681.959831] LustreError: 345915:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8681.962487] LustreError: 345915:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8681.965115] LustreError: 342370:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8681.989137] LustreError: 345923:0:(obd_config.c:1997:class_config_llog_handler()) MGC192.168.204.125@tcp: cfg command failed: rc = -17 [ 8681.993331] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 8681.993331] [ 8977.215435] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.25@tcp (stopping) [ 8977.218753] Lustre: Skipped 1 previous similar message [ 8979.425400] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8979.425751] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8979.434209] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8979.437149] Lustre: Skipped 1 previous similar message [ 8982.396222] LustreError: 357316:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 8982.398498] LustreError: 357316:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 8982.422231] Lustre: server umount lustre-MDT0001 complete [ 8983.363683] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8984.544342] LustreError: 342397:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8984.549010] LustreError: 342397:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8985.988954] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8986.020544] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8986.022277] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8986.034483] Lustre: 342367:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8986.154819] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8987.437878] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8991.206064] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8992.741646] LustreError: 358441:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8992.743573] LustreError: 358441:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8992.746059] LustreError: 342370:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8992.749090] LustreError: 342370:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8992.767224] LustreError: 358444:0:(obd_config.c:689:class_setup()) Device 8 already setup (type osp) [ 8992.769044] LustreError: 358444:0:(obd_config.c:1997:class_config_llog_handler()) MGC192.168.204.125@tcp: cfg command failed: rc = -17 [ 8992.771284] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.204.125@tcp [ 8992.771284] [ 9293.282388] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9293.282545] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 9293.288538] Lustre: Skipped 1 previous similar message [ 9293.291520] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9293.294224] Lustre: Skipped 2 previous similar messages [ 9296.252824] LustreError: 369884:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 9296.255731] LustreError: 369884:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 9296.280209] Lustre: server umount lustre-MDT0001 complete [ 9297.315211] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9298.402320] LustreError: 342397:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9298.409284] LustreError: 342397:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9300.065911] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9300.103561] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 9300.106916] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9300.124704] Lustre: 342367:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9300.268648] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 9301.733822] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9305.577230] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 9306.083984] LustreError: 370960:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 9306.086684] LustreError: 370960:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 9306.090172] LustreError: 342370:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 9306.092120] LustreError: 342370:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 9306.107299] LustreError: 370963:0:(lod_lov.c:207:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 9306.112304] LustreError: 370963:0:(obd_config.c:1997:class_config_llog_handler()) MGC192.168.204.125@tcp: cfg command failed: rc = -114 [ 9306.114795] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 9306.114795] [ 9617.890129] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9617.890766] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9617.891893] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9617.891897] Lustre: Skipped 1 previous similar message [ 9617.893562] Lustre: Skipped 1 previous similar message [ 9621.373408] LustreError: 382566:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 9621.375240] LustreError: 382566:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 9621.404341] Lustre: server umount lustre-MDT0000 complete [ 9622.665094] LustreError: 342358:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763355316 with bad export cookie 13052531882089060551 [ 9622.668294] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9622.669772] LustreError: 342358:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9623.007975] LustreError: 342375:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9623.012970] LustreError: 342375:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9627.039820] LustreError: 342375:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9628.799896] LustreError: 382768:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 9628.801663] LustreError: 382768:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 9628.853819] Lustre: server umount lustre-MDT0001 complete [ 9630.261960] Lustre: server umount lustre-OST0000 complete [ 9633.265603] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 9636.629611] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 9640.022879] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9642.228424] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9644.350974] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9646.676264] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9649.037410] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 23:55:41 (1763355341) [ 9651.379298] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9651.399107] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9651.484836] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9651.495210] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9651.535240] Lustre: lustre-MDT0000: new disk, initializing [ 9651.560565] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9651.568600] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9652.967114] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9657.246408] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9657.274630] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9657.312774] Lustre: 385500:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9657.341917] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9657.343697] Lustre: Skipped 1 previous similar message [ 9657.383726] Lustre: lustre-MDT0001: new disk, initializing [ 9657.426417] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9657.439168] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9657.444279] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9658.862761] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9661.982094] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9663.172798] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9665.427064] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9665.451172] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9665.547801] Lustre: lustre-OST0000: new disk, initializing [ 9665.549574] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9665.578075] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9666.166174] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9666.169038] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9666.207096] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9667.525742] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9670.661660] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9676.769075] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9676.771301] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9676.773893] Lustre: Skipped 3 previous similar messages [ 9676.776031] Lustre: Skipped 5 previous similar messages [ 9679.555720] LustreError: 387944:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 9679.557522] LustreError: 387944:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages [ 9679.587884] Lustre: server umount lustre-MDT0000 complete [ 9680.890192] LustreError: 385490:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763355374 with bad export cookie 13052531882089062504 [ 9680.892457] LustreError: 386292:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 9680.893199] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9680.893288] LustreError: 385490:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9681.037700] Lustre: server umount lustre-MDT0001 complete [ 9692.706402] Lustre: server umount lustre-OST0000 complete [ 9702.488450] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 9706.100163] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 9709.728755] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9712.274461] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9714.520455] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9716.907790] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9717.573116] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 9487 sec ========== 23:56:50 (1763355410) [ 9718.186975] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 23:56:50 (1763355410) === [ 9719.423117] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 23:56:52 (1763355412) === [ 9733.019985] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 9734.034824] Key type lgssc unregistered [ 9734.169367] LNet: 393446:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9734.171230] LNetError: 393446:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9734.182440] LNet: Removed LNI 192.168.204.125@tcp [ 9734.483333] Key type .llcrypt unregistered [ 9734.484160] Key type ._llcrypt unregistered