[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 451182901 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001009] APIC: Switch to symmetric I/O mode setup [ 0.002157] x2apic enabled [ 0.003005] Switched APIC routing to physical x2apic. [ 0.003913] kvm-guest: setup PV IPIs [ 0.006319] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007023] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008015] pid_max: default: 32768 minimum: 301 [ 0.009111] LSM: Security Framework initializing [ 0.011064] Yama: becoming mindful. [ 0.012053] SELinux: Initializing. [ 0.013072] *** VALIDATE selinux *** [ 0.021611] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026553] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.027187] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028134] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029099] *** VALIDATE tmpfs *** [ 0.030504] *** VALIDATE proc *** [ 0.032052] *** VALIDATE cgroup *** [ 0.033009] *** VALIDATE cgroup2 *** [ 0.034233] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.035116] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.036008] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.037024] Spectre V2 : User space: Vulnerable [ 0.038007] Speculative Store Bypass: Vulnerable [ 0.041297] debug: unmapping init [mem 0xffffffff96859000-0xffffffff96860fff] [ 0.043970] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.044688] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.045026] ... version: 2 [ 0.046010] ... bit width: 48 [ 0.047013] ... generic registers: 4 [ 0.048010] ... value mask: 0000ffffffffffff [ 0.048994] ... max period: 00007fffffffffff [ 0.049018] ... fixed-purpose events: 3 [ 0.050013] ... event mask: 000000070000000f [ 0.051246] rcu: Hierarchical SRCU implementation. [ 0.053191] smp: Bringing up secondary CPUs ... [ 0.054419] x86: Booting SMP configuration: [ 0.055019] .... node #0, CPUs: #1 #2 #3 [ 0.058443] smp: Brought up 1 node, 4 CPUs [ 0.059709] smpboot: Max logical packages: 1 [ 0.060012] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.115020] node 0 deferred pages initialised in 52ms [ 0.119182] devtmpfs: initialized [ 0.120208] x86/mm: Memory block size: 128MB [ 0.122371] gcov: version magic: 0x41383552 [ 0.124162] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.125063] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.126245] pinctrl core: initialized pinctrl subsystem [ 0.127200] [ 0.127776] ************************************************************* [ 0.128017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.129016] ** ** [ 0.130012] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.131012] ** ** [ 0.132011] ** This means that this kernel is built to expose internal ** [ 0.133007] ** IOMMU data structures, which may compromise security on ** [ 0.134012] ** your system. ** [ 0.135008] ** ** [ 0.136015] ** If you see this message and you are not debugging the ** [ 0.137011] ** kernel, report this immediately to your vendor! ** [ 0.138018] ** ** [ 0.139015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.140017] ************************************************************* [ 0.141690] NET: Registered protocol family 16 [ 0.142488] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.143072] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.144080] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.145412] cpuidle: using governor menu [ 0.147035] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.148386] PCI: Using configuration type 1 for base access [ 0.150124] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.158102] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.159014] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.160127] cryptd: max_cpu_qlen set to 1000 [ 0.162010] ACPI: Added _OSI(Module Device) [ 0.163013] ACPI: Added _OSI(Processor Device) [ 0.164011] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.165013] ACPI: Added _OSI(Processor Aggregator Device) [ 0.169280] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.173183] ACPI: Interpreter enabled [ 0.174040] ACPI: PM: (supports S0 S3 S4 S5) [ 0.174991] ACPI: Using IOAPIC for interrupt routing [ 0.175140] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.176290] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.183457] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.184038] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.185021] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.186080] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.187952] acpiphp: Slot [2] registered [ 0.188107] acpiphp: Slot [5] registered [ 0.189065] acpiphp: Slot [6] registered [ 0.189925] acpiphp: Slot [7] registered [ 0.190064] acpiphp: Slot [8] registered [ 0.190983] acpiphp: Slot [9] registered [ 0.191091] acpiphp: Slot [10] registered [ 0.192046] acpiphp: Slot [3] registered [ 0.192982] acpiphp: Slot [4] registered [ 0.193073] acpiphp: Slot [11] registered [ 0.193955] acpiphp: Slot [12] registered [ 0.194082] acpiphp: Slot [13] registered [ 0.195091] acpiphp: Slot [14] registered [ 0.196073] acpiphp: Slot [15] registered [ 0.197066] acpiphp: Slot [16] registered [ 0.198084] acpiphp: Slot [17] registered [ 0.199097] acpiphp: Slot [18] registered [ 0.200083] acpiphp: Slot [19] registered [ 0.201098] acpiphp: Slot [20] registered [ 0.202110] acpiphp: Slot [21] registered [ 0.203087] acpiphp: Slot [22] registered [ 0.204011] acpiphp: Slot [23] registered [ 0.205080] acpiphp: Slot [24] registered [ 0.206099] acpiphp: Slot [25] registered [ 0.207099] acpiphp: Slot [26] registered [ 0.208084] acpiphp: Slot [27] registered [ 0.209084] acpiphp: Slot [28] registered [ 0.210072] acpiphp: Slot [29] registered [ 0.212192] acpiphp: Slot [30] registered [ 0.213095] acpiphp: Slot [31] registered [ 0.215088] PCI host bridge to bus 0000:00 [ 0.216018] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.219020] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.221024] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.224023] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.226020] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.229026] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.231175] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.235010] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.238415] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.248828] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.253134] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.256025] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.258014] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.260020] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.263521] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.265673] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.268054] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.271854] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.277015] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.288011] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.293012] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.299923] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.307016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.318019] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.341017] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.351970] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.360025] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.368023] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.387029] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.400235] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.413017] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.419018] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.436022] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.446556] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.459022] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.471018] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.495019] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.509864] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.515017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.521018] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.535030] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.543348] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.551022] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.558017] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.582026] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.594619] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.597366] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.598557] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.601326] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.603458] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.609032] iommu: Default domain type: Passthrough [ 0.610450] SCSI subsystem initialized [ 0.613110] ACPI: bus type USB registered [ 0.615141] usbcore: registered new interface driver usbfs [ 0.617080] usbcore: registered new interface driver hub [ 0.618085] usbcore: registered new device driver usb [ 0.620180] pps_core: LinuxPPS API ver. 1 registered [ 0.622021] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.624084] PTP clock support registered [ 0.627034] EDAC MC: Ver: 3.0.0 [ 0.629162] PCI: Using ACPI for IRQ routing [ 0.631210] NetLabel: Initializing [ 0.632016] NetLabel: domain hash size = 128 [ 0.634011] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.635139] NetLabel: unlabeled traffic allowed by default [ 0.638046] vgaarb: loaded [ 0.639280] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.641016] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.647158] clocksource: Switched to clocksource kvm-clock [ 0.763823] VFS: Disk quotas dquot_6.6.0 [ 0.765692] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.768411] *** VALIDATE ramfs *** [ 0.769874] *** VALIDATE hugetlbfs *** [ 0.771500] pnp: PnP ACPI init [ 0.774647] pnp: PnP ACPI: found 6 devices [ 0.790881] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.793658] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.795181] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.797381] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.799484] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.801692] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.804414] NET: Registered protocol family 2 [ 0.806757] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.811073] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.814765] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.820095] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.823631] TCP: Hash tables configured (established 65536 bind 65536) [ 0.826522] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.829405] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.831361] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.833856] NET: Registered protocol family 1 [ 0.835784] RPC: Registered named UNIX socket transport module. [ 0.837468] RPC: Registered udp transport module. [ 0.838601] RPC: Registered tcp transport module. [ 0.839994] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.841874] NET: Registered protocol family 44 [ 0.843815] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.845840] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.847262] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.848689] PCI: CLS 0 bytes, default 64 [ 0.849797] Unpacking initramfs... [ 2.153859] debug: unmapping init [mem 0xffff92237cc54000-0xffff92237ffbffff] [ 2.157740] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.160035] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.162714] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.628520] Initialise system trusted keyrings [ 2.630013] Key type blacklist registered [ 2.632870] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.642809] zbud: loaded [ 2.645810] *** VALIDATE nfs *** [ 2.646855] *** VALIDATE nfs4 *** [ 2.648669] pstore: using deflate compression [ 2.653720] Platform Keyring initialized [ 2.724468] NET: Registered protocol family 38 [ 2.725752] Key type asymmetric registered [ 2.726686] Asymmetric key parser 'x509' registered [ 2.728392] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.731234] io scheduler mq-deadline registered [ 2.732709] io scheduler kyber registered [ 2.734573] io scheduler bfq registered [ 2.736247] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.738535] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.740187] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.741766] ACPI: Power Button [PWRF] [ 2.745510] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.750661] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.768480] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 2.776118] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 2.791515] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.822113] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.852042] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.861089] Non-volatile memory driver v1.3 [ 2.862728] Linux agpgart interface v0.103 [ 2.892060] virtio_blk virtio1: [vda] 134864 512-byte logical blocks (69.1 MB/65.9 MiB) [ 2.894583] vda: detected capacity change from 0 to 69050368 [ 2.909661] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.912707] vdb: detected capacity change from 0 to 1073741824 [ 2.930445] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.933969] vdc: detected capacity change from 0 to 2621440000 [ 2.949570] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.952509] vdd: detected capacity change from 0 to 2621440000 [ 2.975622] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 2.978730] vde: detected capacity change from 0 to 4294967296 [ 2.993965] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 2.997199] vdf: detected capacity change from 0 to 4294967296 [ 3.003634] libphy: Fixed MDIO Bus: probed [ 3.008955] usbcore: registered new interface driver usbserial_generic [ 3.011940] usbserial: USB Serial support registered for generic [ 3.014603] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.019499] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.021530] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.023983] mousedev: PS/2 mouse device common for all mice [ 3.026342] rtc_cmos 00:05: RTC can wake from S4 [ 3.029683] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.031083] rtc_cmos 00:05: registered as rtc0 [ 3.033871] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.035920] intel_pstate: CPU model not supported [ 3.037877] hid: raw HID events driver (C) Jiri Kosina [ 3.039431] usbcore: registered new interface driver usbhid [ 3.040585] usbhid: USB HID core driver [ 3.041425] drop_monitor: Initializing network drop monitor service [ 3.043104] Initializing XFRM netlink socket [ 3.044261] NET: Registered protocol family 10 [ 3.046735] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.047201] Segment Routing with IPv6 [ 3.052834] NET: Registered protocol family 17 [ 3.054701] mpls_gso: MPLS GSO support [ 3.056417] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.063079] RAS: Correctable Errors collector initialized. [ 3.065742] AVX version of gcm_enc/dec engaged. [ 3.067937] AES CTR mode by8 optimization enabled [ 3.144506] sched_clock: Marking stable (3144424948, 0)->(4019728257, -875303309) [ 3.148214] registered taskstats version 1 [ 3.150249] Loading compiled-in X.509 certificates [ 3.152265] zswap: loaded using pool lzo/zbud [ 3.175850] Key type big_key registered [ 3.195547] Key type encrypted registered [ 3.196645] ima: No TPM chip found, activating TPM-bypass! [ 3.197854] ima: Allocated hash algorithm: sha1 [ 3.199191] ima: No architecture policies found [ 3.200534] evm: Initialising EVM extended attributes: [ 3.201815] evm: security.selinux [ 3.203064] evm: security.ima [ 3.204135] evm: security.capability [ 3.205429] evm: HMAC attrs: 0x1 [ 3.207629] rtc_cmos 00:05: setting system clock to 2026-06-01 17:35:34 UTC (1780335334) [ 3.212768] debug: unmapping init [mem 0xffffffff97803000-0xffffffff979fffff] [ 3.215848] debug: unmapping init [mem 0xffffffff96582000-0xffffffff96858fff] [ 3.224102] Write protecting the kernel read-only data: 28672k [ 3.227148] debug: unmapping init [mem 0xffffffff94c03000-0xffffffff94dfffff] [ 3.229933] debug: unmapping init [mem 0xffffffff95514000-0xffffffff955fffff] [ 3.265830] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.272359] systemd[1]: Detected virtualization kvm. [ 3.274035] systemd[1]: Detected architecture x86-64. [ 3.275827] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.302273] systemd[1]: No hostname configured. [ 3.303409] systemd[1]: Set hostname to . [ 3.305093] random: systemd: uninitialized urandom read (16 bytes read) [ 3.307335] systemd[1]: Initializing machine ID from random generator. [ 3.422131] random: systemd: uninitialized urandom read (16 bytes read) [ 3.423730] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 3.426933] random: systemd: uninitialized urandom read (16 bytes read) [ 3.428328] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 3.431586] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Setup Virtual Console... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. Starting Create list of required st…ce nodes for the current kernel... Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. Starting Apply Kernel Variables... Starting Create Volatile Files and Directories... [ OK ] Reached target Swap. [ OK ] Reached target Slices. [ OK ] Reached target Paths. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.021331] device-mapper: uevent: version 1.0.3 [ 4.023706] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook.[ 4.263665] random: fast init done Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 4.792462] virtio_net virtio0 ens2: renamed from eth0 [ 4.932587] scsi host0: ata_piix [ 5.018240] scsi host1: ata_piix [ 5.025302] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.028047] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 8.675048] dracut-initqueue[579]: RTNETLINK answers: File exists [ 9.710767] random: crng init done [ 9.711906] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.195076] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.524538] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.780613] SELinux: Disabled at runtime. [ 11.844302] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.850507] systemd[1]: Detected virtualization kvm. [ 11.852510] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.296495] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.299200] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.303191] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.305771] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.308222] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.323927] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.333407] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Switch Root. [ OK ] Listening on udev Control Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Created slice system-getty.slice. [ OK ] Listening on Process Core Dump Socket. Starting Remount Root and Kernel File Systems... Mounting Huge Pages File System... [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Apply Kernel Variables... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting udev Coldplug all Devices... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on initctl Compatibility Named Pipe. Mounting POSIX Message Queue File System... Starting Create list of required st…ce nodes for the current kernel... [ 12.510734] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... Starting udev Kernel Device Manager... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 12.866318] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 13.218960] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.254095] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.456795] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.471819] EDAC sbridge: Ver: 1.1.2 [ 15.068453] Key type dns_resolver registered [ 15.424952] NFS: Registering the id_resolver key type [ 15.426500] Key type id_resolver registered [ 15.427613] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started RPC Bind. [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg223-server login: [ 50.192327] libcfs: loading out-of-tree module taints kernel. [ 50.236295] Key type ._llcrypt registered [ 50.239563] Key type .llcrypt registered [ 50.379370] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 71.458551] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 73.891874] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 73.904206] alg: No test for adler32 (adler32-zlib) [ 75.750382] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 76.562896] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 78.536257] Key type lgssc registered [ 81.309751] Lustre: Echo OBD driver; http://www.lustre.org/ [ 105.194326] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 110.975135] hrtimer: interrupt took 2175593 ns [ 151.996454] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 166.732563] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 166.772081] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 167.997061] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 168.044229] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 168.168955] Lustre: lustre-MDT0000: new disk, initializing [ 168.302991] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 168.327170] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 171.584717] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 187.276649] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 187.405867] Lustre: 6499:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 187.445928] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 187.452636] Lustre: Skipped 1 previous similar message [ 187.592184] Lustre: lustre-MDT0001: new disk, initializing [ 187.702359] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 187.728955] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 187.745735] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 193.161647] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 197.891696] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 206.810905] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 207.037977] Lustre: lustre-OST0000: new disk, initializing [ 207.040822] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 207.044878] Lustre: 8406:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 207.083715] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 211.553359] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 211.569289] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 211.702089] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 214.181854] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 228.789750] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 228.930757] Lustre: lustre-OST0001: new disk, initializing [ 228.934350] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 228.938802] Lustre: 9464:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 228.994286] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 235.641982] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 235.652442] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 235.764711] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 235.925738] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 248.754437] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 254.606583] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 260.926867] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing check_logdir /tmp/testlogs/ [ 267.366798] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing yml_node [ 272.437330] Lustre: DEBUG MARKER: Client: 2.17.53.34 [ 275.019842] Lustre: DEBUG MARKER: MDS: 2.17.53.34 [ 278.267158] Lustre: DEBUG MARKER: OSS: 2.17.53.34 [ 279.975277] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Mon Jun 1 13:40:09 EDT 2026 [ 296.335401] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 297.625467] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 315.873308] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 315.876452] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 315.884991] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 317.922135] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 317.924382] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 317.951491] Lustre: Skipped 2 previous similar messages [ 317.957912] Lustre: Skipped 2 previous similar messages [ 319.210660] Lustre: server umount lustre-MDT0000 complete [ 322.900393] LustreError: 6491:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335654 with bad export cookie 300947067657931151 [ 322.906519] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 322.920958] LustreError: 6491:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 323.040833] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 323.050456] Lustre: Skipped 1 previous similar message [ 323.056948] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 323.068253] Lustre: Skipped 2 previous similar messages [ 327.074060] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 327.079630] Lustre: Skipped 1 previous similar message [ 332.257519] LustreError: 6508:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 332.265547] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 332.284866] LustreError: 6508:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 332.299319] Lustre: Skipped 1 previous similar message [ 333.290278] LustreError: 6506:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 333.311914] LustreError: 6506:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 337.376213] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 337.661660] Lustre: server umount lustre-MDT0001 complete [ 342.105550] Lustre: server umount lustre-OST0000 complete [ 346.341953] Lustre: server umount lustre-OST0001 complete [ 353.786935] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 366.248882] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 405.251931] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 405.444275] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 405.480708] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 405.557840] Lustre: lustre-MDT0000: new disk, initializing [ 405.632578] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 405.659972] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 409.432661] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 420.240069] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 420.357419] Lustre: 14981:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 420.411842] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 420.419685] Lustre: Skipped 1 previous similar message [ 420.519837] Lustre: lustre-MDT0001: new disk, initializing [ 420.632503] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 420.673492] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 420.684265] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 425.135765] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 433.424716] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 438.391205] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 446.891208] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 447.258472] Lustre: lustre-OST0000: new disk, initializing [ 447.261201] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 447.268353] Lustre: 16725:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 447.438189] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 449.092188] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 449.108407] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 449.345743] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 455.980514] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 464.445452] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 469.381357] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 469.691924] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 474.582369] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 474.833612] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 480.235168] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 480.240168] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 480.254307] Lustre: Skipped 1 previous similar message [ 480.254667] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 480.262831] LustreError: Skipped 1 previous similar message [ 480.266914] Lustre: Skipped 3 previous similar messages [ 482.927289] Lustre: server umount lustre-OST0000 complete [ 487.395362] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 487.401215] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 493.669655] Lustre: server umount lustre-MDT0000 complete [ 495.585410] LustreError: 14987:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 495.613315] LustreError: 14987:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 497.684840] LustreError: 15761:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335828 with bad export cookie 300947067657932726 [ 497.689314] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 497.711323] LustreError: 15761:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 498.492756] Lustre: server umount lustre-MDT0001 complete [ 504.083941] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 13:43:53 (1780335833) [ 510.680965] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 511.324556] LustreError: 18843:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 511.432853] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 515.711307] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 516.588972] LustreError: 18844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 523.937571] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 529.383326] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 534.811373] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 538.198861] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 544.878146] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 552.346577] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 557.850325] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 561.926895] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 567.273597] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 567.275849] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 567.291959] Lustre: Skipped 2 previous similar messages [ 567.321702] Lustre: Skipped 5 previous similar messages [ 573.767401] Lustre: server umount lustre-MDT0000 complete [ 577.521304] LustreError: 18838:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 577.552512] LustreError: 18838:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 577.768915] LustreError: 21032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780335909 with bad export cookie 300947067657933650 [ 577.774430] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 577.780874] LustreError: 21032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 578.378142] Lustre: server umount lustre-MDT0001 complete [ 593.355245] Lustre: server umount lustre-OST0000 complete [ 613.998328] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 623.359652] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 623.725069] LustreError: 22867:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 623.798491] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 623.804034] Lustre: Skipped 2 previous similar messages [ 628.010322] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 636.475234] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 641.309599] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 644.145509] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 650.738084] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 657.967323] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 667.169781] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 667.375626] Lustre: lustre-OST0001: new disk, initializing [ 667.381836] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 667.391962] Lustre: 25135:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 668.730397] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 668.747517] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 668.866139] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 674.508593] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 683.369339] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 687.366054] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 703.457424] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 703.467784] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 703.482267] Lustre: Skipped 1 previous similar message [ 703.490066] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 703.497013] Lustre: Skipped 3 previous similar messages [ 709.769294] Lustre: server umount lustre-MDT0000 complete [ 711.138887] LustreError: 22868:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 711.169649] LustreError: 22868:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 713.906872] LustreError: 23595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336045 with bad export cookie 300947067657934497 [ 713.918332] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 713.927055] LustreError: 23595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 714.235898] Lustre: server umount lustre-MDT0001 complete [ 729.211743] Lustre: server umount lustre-OST0000 complete [ 732.384111] Lustre: 3650:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780336047/real 1780336047] req@ffff9222c1294700 x1866816979982976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780336063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 733.205742] Lustre: server umount lustre-OST0001 complete [ 751.785809] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 763.222402] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 764.057399] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 764.071052] Lustre: Skipped 3 previous similar messages [ 768.841805] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 778.486116] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 783.627209] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 786.837345] Lustre: 29236:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 793.884097] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 800.614344] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 804.518071] LustreError: 29589:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 804.549223] LustreError: 29589:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 811.371361] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 818.147368] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 826.030812] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 830.001320] Lustre: 31079:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 837.615790] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 837.637141] Lustre: Skipped 4 previous similar messages [ 837.640397] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 837.657686] Lustre: Skipped 7 previous similar messages [ 842.856986] Lustre: server umount lustre-MDT0000 complete [ 846.398201] LustreError: 28102:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336177 with bad export cookie 300947067657935785 [ 846.404986] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 846.408204] LustreError: 28102:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 846.862595] Lustre: server umount lustre-MDT0001 complete [ 860.056207] Lustre: server umount lustre-OST0000 complete [ 864.224303] Lustre: 3652:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780336179/real 1780336179] req@ffff9223f762ea00 x1866816980033280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780336195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 864.639294] Lustre: server umount lustre-OST0001 complete [ 873.137217] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 13:50:02 (1780336202) [ 900.250897] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 911.694254] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 915.894649] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 924.799251] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 930.491988] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 933.836954] Lustre: 34985:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 943.597684] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 950.208021] LustreError: 35341:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 950.235189] LustreError: 35341:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 951.176354] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 959.303463] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 965.990557] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 973.496918] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 977.218303] Lustre: 36832:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 985.068538] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 985.071958] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 985.087300] Lustre: Skipped 5 previous similar messages [ 985.109865] Lustre: Skipped 3 previous similar messages [ 988.933387] Lustre: server umount lustre-MDT0000 complete [ 992.920657] LustreError: 33847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336324 with bad export cookie 300947067657936898 [ 992.921906] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 992.934308] LustreError: 33847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 993.491119] Lustre: server umount lustre-MDT0001 complete [ 1007.865981] Lustre: server umount lustre-OST0000 complete [ 1010.785083] Lustre: 3652:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780336326/real 1780336326] req@ffff9223e7799500 x1866816980084992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1780336342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1011.812480] Lustre: server umount lustre-OST0001 complete [ 1022.020764] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 13:52:31 (1780336351) [ 1041.176849] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 1052.295080] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1052.705027] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1052.710967] Lustre: Skipped 7 previous similar messages [ 1057.264821] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1068.496658] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1075.028422] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1078.829488] Lustre: 40078:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1087.108410] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1093.454458] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1104.875364] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1113.425573] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1121.625938] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1125.709196] Lustre: 41921:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1126.587761] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1126.591774] Lustre: Skipped 1 previous similar message [ 1130.465759] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1130.489258] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1130.510206] Lustre: Skipped 2 previous similar messages [ 1135.623202] Lustre: server umount lustre-MDT0000 complete [ 1139.920762] LustreError: 38939:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336471 with bad export cookie 300947067657938004 [ 1139.933715] LustreError: 38939:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1139.934680] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1146.554634] Lustre: server umount lustre-MDT0001 complete [ 1157.781858] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1165.731877] LustreError: 3649:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9223f31a4000 x1866816980139136/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1171.234654] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1175.571483] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1180.582318] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1186.303679] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1186.308402] Lustre: Skipped 1 previous similar message [ 1186.905499] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1193.230210] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1195.309798] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1199.625632] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1201.403460] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1211.873176] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1213.713774] Lustre: server umount lustre-MDT0000 complete [ 1217.005489] LustreError: 42794:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1217.056968] LustreError: 42794:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 42 previous similar messages [ 1218.095304] LustreError: 38939:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336549 with bad export cookie 300947067657939131 [ 1218.100330] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1218.113891] LustreError: 38939:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1218.493644] Lustre: server umount lustre-MDT0001 complete [ 1232.013802] Lustre: server umount lustre-OST0000 complete [ 1247.016985] Lustre: server umount lustre-OST0001 complete [ 1256.682862] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 13:56:26 (1780336586) [ 1274.219453] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 1284.944831] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1290.999803] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1300.732814] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1306.027892] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1309.749317] Lustre: 47411:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1317.358624] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1324.113201] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1334.663090] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1342.611894] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1351.038683] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1356.187543] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1369.063629] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1369.068920] Lustre: Skipped 17 previous similar messages [ 1370.684875] Lustre: server umount lustre-MDT0000 complete [ 1374.392968] LustreError: 46269:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780336705 with bad export cookie 300947067657939929 [ 1374.405483] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1374.415076] LustreError: 46269:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 1374.800985] Lustre: server umount lustre-MDT0001 complete [ 1389.705953] Lustre: server umount lustre-OST0000 complete [ 1404.511344] Lustre: server umount lustre-OST0001 complete [ 1414.890405] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 13:59:04 (1780336744) [ 1417.602700] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1419.425556] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 13:59:09 (1780336749) [ 1430.623988] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 1444.689995] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 1474.536295] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1475.109019] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1475.413271] Lustre: lustre-MDT0000: new disk, initializing [ 1475.753854] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1483.279404] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1492.646394] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1499.601810] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1500.018419] Lustre: lustre-OST0000: new disk, initializing [ 1500.028038] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1500.040681] Lustre: Skipped 1 previous similar message [ 1500.049460] Lustre: 53309:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1501.812186] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1501.823523] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1501.866159] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1507.294609] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1514.964454] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1517.341850] Lustre: DEBUG MARKER: create test files [ 1547.747514] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1547.760207] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1547.772786] Lustre: Skipped 13 previous similar messages [ 1551.748446] Lustre: server umount lustre-OST0000 complete [ 1556.245281] Lustre: server umount lustre-MDT0000 complete [ 1568.721830] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 1572.220227] Key type lgssc unregistered [ 1572.547838] LNet: 54819:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1572.565159] LNetError: 54819:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1572.579930] LNet: Removed LNI 192.168.202.123@tcp [ 1573.499169] Key type .llcrypt unregistered [ 1573.501334] Key type ._llcrypt unregistered [ 1606.642281] Key type ._llcrypt registered [ 1606.645147] Key type .llcrypt registered [ 1606.781962] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 1608.432711] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1608.528610] alg: No test for adler32 (adler32-zlib) [ 1609.498935] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 1609.698536] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 1611.424218] Key type lgssc registered [ 1612.653655] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1620.927556] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1620.951318] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1622.639080] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1627.742872] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1633.883592] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1640.399456] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1640.623458] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1646.779229] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:101 to 0x240000400:129) [ 1646.845646] Lustre: 57432:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1646.853833] Lustre: 57432:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1646.866742] Lustre: 57432:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1646.871925] Lustre: 57432:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1646.880684] Lustre: 57432:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1646.889690] Lustre: 57432:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1647.440831] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1654.026098] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1660.286642] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1666.337425] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1677.794731] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1677.806215] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1677.827665] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1680.474692] Lustre: server umount lustre-OST0000 complete [ 1685.386829] Lustre: server umount lustre-MDT0000 complete [ 1697.227543] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 1699.859467] Key type lgssc unregistered [ 1700.190075] LNet: 58909:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1700.196519] LNetError: 58909:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1700.208715] LNet: Removed LNI 192.168.202.123@tcp [ 1701.075805] Key type .llcrypt unregistered [ 1701.078450] Key type ._llcrypt unregistered [ 1734.265260] Key type ._llcrypt registered [ 1734.271875] Key type .llcrypt registered [ 1734.417318] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 1735.055714] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1735.066272] alg: No test for adler32 (adler32-zlib) [ 1736.095118] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 1736.255278] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 1737.920201] Key type lgssc registered [ 1739.263784] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1748.194820] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1748.253443] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1750.299176] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1754.950278] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1761.267199] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1768.806022] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1769.297891] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1775.498665] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1775.555446] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1775.597391] Lustre: 61617:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1775.613956] Lustre: 61617:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1775.619527] Lustre: 61617:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1775.628036] Lustre: 61617:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1775.635761] Lustre: 61617:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1775.649774] Lustre: 61617:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1783.427446] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1789.824092] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1801.187649] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1801.210062] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1805.418120] Lustre: server umount lustre-OST0000 complete [ 1809.048041] Lustre: server umount lustre-MDT0000 complete [ 1819.746509] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 1822.282897] Key type lgssc unregistered [ 1822.630083] LNet: 63043:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1822.634589] LNetError: 63043:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1822.658687] LNet: Removed LNI 192.168.202.123@tcp [ 1823.218577] Key type .llcrypt unregistered [ 1823.220212] Key type ._llcrypt unregistered [ 1841.559794] Key type ._llcrypt registered [ 1841.562391] Key type .llcrypt registered [ 1841.702375] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 1857.637438] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 1858.767492] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1858.914951] alg: No test for adler32 (adler32-zlib) [ 1860.148955] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 1860.473334] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 1862.280122] Key type lgssc registered [ 1863.702279] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1897.688389] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1897.718729] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1898.962493] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1898.999507] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1899.108359] Lustre: lustre-MDT0000: new disk, initializing [ 1899.211255] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1899.227732] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1903.275974] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1913.798070] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1913.946926] Lustre: 66163:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1914.051838] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1914.060078] Lustre: Skipped 1 previous similar message [ 1914.156929] Lustre: lustre-MDT0001: new disk, initializing [ 1914.322540] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1914.366113] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1914.391308] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1919.098695] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1927.585305] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1931.901564] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1938.735677] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1939.019848] Lustre: lustre-OST0000: new disk, initializing [ 1939.023752] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1939.032666] Lustre: 67908:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1939.148522] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1945.254097] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1945.268602] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1945.434617] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1945.987533] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 1952.989897] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1958.173758] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1958.340200] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1962.717261] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1962.910598] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1966.051937] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1966.057557] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1966.070410] LustreError: Skipped 1 previous similar message [ 1966.071147] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1966.101689] Lustre: Skipped 1 previous similar message [ 1970.992409] Lustre: server umount lustre-OST0000 complete [ 1975.787865] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1975.796905] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1975.824967] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1975.827449] Lustre: Skipped 1 previous similar message [ 1980.660559] Lustre: server umount lustre-MDT0000 complete [ 1984.433754] LustreError: 66155:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337315 with bad export cookie 5088317982633253214 [ 1984.437225] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1984.453993] LustreError: 66155:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1984.969072] Lustre: server umount lustre-MDT0001 complete [ 1994.577855] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 14:08:44 (1780337324) [ 2006.815545] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 2047.498772] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 2056.516917] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 2094.863157] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2095.092331] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2095.112791] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2095.195089] Lustre: lustre-MDT0000: new disk, initializing [ 2095.311125] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2095.333277] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2099.636210] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2111.077418] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2111.226352] Lustre: 73730:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2111.287354] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2111.292523] Lustre: Skipped 1 previous similar message [ 2111.372779] Lustre: lustre-MDT0001: new disk, initializing [ 2111.469097] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2111.520862] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2111.532304] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2115.545512] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2123.549465] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2127.867697] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2134.568517] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2134.898861] Lustre: lustre-OST0000: new disk, initializing [ 2134.905896] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2134.916906] Lustre: 75473:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2135.048283] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2141.407585] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2143.842574] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2143.851514] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2143.981187] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2150.682632] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2157.449057] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2157.758484] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2164.076960] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2164.577738] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2169.828687] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2169.830994] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2169.851015] Lustre: Skipped 1 previous similar message [ 2169.863886] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2169.869387] Lustre: Skipped 2 previous similar messages [ 2173.737662] Lustre: server umount lustre-OST0000 complete [ 2180.071436] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2180.079070] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2180.084630] Lustre: Skipped 2 previous similar messages [ 2180.109194] Lustre: Skipped 1 previous similar message [ 2185.168636] Lustre: server umount lustre-MDT0000 complete [ 2185.195506] LustreError: 73737:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2185.221526] LustreError: 73737:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2188.250728] LustreError: 73723:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337519 with bad export cookie 5088317982633254138 [ 2188.252396] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2188.259875] LustreError: 73723:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2188.694053] Lustre: server umount lustre-MDT0001 complete [ 2198.299404] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 14:12:08 (1780337528) [ 2205.062963] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2205.353161] LustreError: 77738:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2205.411685] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2210.371465] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2210.790216] LustreError: 77739:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2214.891754] LustreError: 77738:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2219.767825] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2220.016650] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 2225.035543] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2230.996585] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2235.621538] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2243.072907] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2243.442545] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2243.447646] Lustre: Skipped 1 previous similar message [ 2249.643825] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2255.233909] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2258.741292] Lustre: 80073:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 8c41adad-f88e-4a4f-b591-aecfea238aca at adminstrative request [ 2260.969406] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2260.996558] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2271.205095] Lustre: MGS: Client 8c41adad-f88e-4a4f-b591-aecfea238aca (at 0@lo) reconnecting [ 2271.222356] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x469d563f03166096 to 0x469d563f03166336 [ 2271.241101] Lustre: MGC192.168.202.123@tcp: Connection restored to 0@lo (at 0@lo) [ 2296.242092] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2296.427388] Lustre: lustre-OST0001: new disk, initializing [ 2296.430662] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2296.436354] Lustre: 80464:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2303.967521] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2304.104300] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2304.129094] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2304.330905] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2312.098815] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2319.844162] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2319.860947] Lustre: Skipped 1 previous similar message [ 2319.865514] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2319.881756] Lustre: Skipped 1 previous similar message [ 2321.692921] Lustre: server umount lustre-OST0001 complete [ 2324.968397] LustreError: 79338:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2324.995242] LustreError: 79338:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2327.521869] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2327.551188] LustreError: Skipped 2 previous similar messages [ 2332.716554] Lustre: server umount lustre-OST0000 complete [ 2338.274223] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2338.282666] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2338.301194] Lustre: Skipped 2 previous similar messages [ 2338.311351] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2338.322063] Lustre: Skipped 4 previous similar messages [ 2342.811978] Lustre: server umount lustre-MDT0000 complete [ 2345.441675] LustreError: 77733:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2345.473584] LustreError: 77733:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2347.332786] LustreError: 77718:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337678 with bad export cookie 5088317982633255734 [ 2347.337890] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2347.354553] LustreError: 77718:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2347.990798] Lustre: server umount lustre-MDT0001 complete [ 2356.799918] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 14:14:46 (1780337686) [ 2358.396629] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2360.179193] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 14:14:49 (1780337689) [ 2361.628751] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2363.920385] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 14:14:53 (1780337693) [ 2365.746838] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2367.611545] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 14:14:57 (1780337697) [ 2368.960954] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2370.926891] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 14:15:00 (1780337700) [ 2372.601710] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2378.752245] loop: module loaded [ 2378.763891] loop0: detected capacity change from 0 to 4294967296 [ 2378.818572] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2380.663371] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2383.788386] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2387.581624] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2414.108829] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2414.163736] LustreError: 84459:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2414.171084] LustreError: 84459:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2414.176484] LustreError: 84459:0:(tgt_mount.c:2537:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2414.199092] LustreError: 84459:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2434.144986] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 2444.039988] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 2482.454328] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2482.685641] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2482.709735] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2482.762692] Lustre: lustre-MDT0000: new disk, initializing [ 2482.853402] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2482.856950] Lustre: Skipped 1 previous similar message [ 2482.880720] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2486.886285] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2498.513880] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2498.626433] Lustre: 87291:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2498.897714] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2503.755273] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2511.485742] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2515.516963] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2523.001093] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2523.522877] Lustre: 89045:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2528.965965] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2529.114163] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2530.936424] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2538.875548] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2543.593558] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2543.853095] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2548.606195] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2548.781616] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2554.860945] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2554.865867] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2554.876623] LustreError: Skipped 1 previous similar message [ 2554.883614] Lustre: Skipped 1 previous similar message [ 2554.884888] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2554.908603] Lustre: Skipped 3 previous similar messages [ 2556.752947] Lustre: server umount lustre-OST0000 complete [ 2576.356417] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2576.817701] Lustre: server umount lustre-MDT0000 complete [ 2580.459447] LustreError: 87301:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2580.478196] LustreError: 87301:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2581.597254] LustreError: 87282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780337912 with bad export cookie 5088317982633256350 [ 2581.605789] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2581.608666] LustreError: 87282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2582.359987] Lustre: server umount lustre-MDT0001 complete [ 2591.303264] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 14:18:41 (1780337921) [ 2598.582538] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2604.043410] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2612.926237] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2613.332983] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 2613.338133] Lustre: Skipped 3 previous similar messages [ 2617.741815] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2623.288800] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2627.010994] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2633.137503] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2639.607063] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2645.468176] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2650.076360] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2650.304243] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2654.884136] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2655.219248] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2662.951407] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2663.150568] Lustre: lustre-OST0001: new disk, initializing [ 2663.152533] Lustre: Skipped 2 previous similar messages [ 2663.154809] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2663.157427] Lustre: Skipped 3 previous similar messages [ 2663.160314] Lustre: 94315:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2668.665113] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2668.673360] Lustre: Skipped 2 previous similar messages [ 2668.676961] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2668.773981] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2668.888269] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2676.281312] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2680.310517] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2680.571546] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2684.713727] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2684.905741] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2706.365604] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2733.724753] Lustre: Failing over lustre-MDT0000 [ 2734.016329] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.23@tcp (stopping) [ 2734.024738] Lustre: Skipped 6 previous similar messages [ 2734.470506] Lustre: server umount lustre-MDT0000 complete [ 2735.604108] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2735.610410] LustreError: 91311:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2735.637974] Lustre: Skipped 5 previous similar messages [ 2735.651027] LustreError: 91311:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2750.945520] Lustre: 64386:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780338066/real 1780338066] req@00000000f2d87090 x1866818850672128/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780338082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2751.005256] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2762.939765] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2762.942575] LDISKFS-fs (dm-0): recovery complete [ 2762.950277] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2778.628599] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x469d563f03172e0c [ 2778.644574] Lustre: MGC192.168.202.123@tcp: Connection restored to 0@lo (at 0@lo) [ 2779.027696] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2780.658263] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2780.671064] Lustre: 94322:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2784.229681] Lustre: 91315:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2784.249700] Lustre: 91315:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 1 previous similar message [ 2784.249728] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2784.270792] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 2784.348339] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2784.680204] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2785.035854] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2785.061286] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 1 previous similar message [ 2785.410396] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2785.419823] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 1 previous similar message [ 2785.446726] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2785.470628] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 7 previous similar messages [ 2786.138694] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2786.151570] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 2 previous similar messages [ 2786.480369] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2786.488852] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 2 previous similar messages [ 2787.443518] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2787.458635] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 5 previous similar messages [ 2788.428239] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2788.444156] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 6 previous similar messages [ 2788.776117] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2788.786568] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 6 previous similar messages [ 2791.671704] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2791.681397] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 12 previous similar messages [ 2792.672518] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2792.683726] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 12 previous similar messages [ 2793.024200] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2793.040206] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 12 previous similar messages [ 2799.763935] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2799.781162] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 24 previous similar messages [ 2800.732380] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2800.738708] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 24 previous similar messages [ 2801.064112] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2801.067610] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 24 previous similar messages [ 2815.914462] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2815.931949] Lustre: 97021:0:(ldlm_lib.c:2069:extend_recovery_timer()) Skipped 50 previous similar messages [ 2816.881259] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2816.893510] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 50 previous similar messages [ 2817.217626] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2817.226116] LustreError: 97021:0:(ldlm_lib.c:2682:replay_request_or_update()) Skipped 50 previous similar messages [ 2840.128222] Lustre: 97021:0:(ldlm_lib.c:2378:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2840.146051] Lustre: 97021:0:(ldlm_lib.c:2388:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2840.162802] Lustre: 97021:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 7ad8772e-85be-4b66-acd8-b0f2382686d1@192.168.202.23@tcp [ 2840.191429] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2840.201364] Lustre: 97021:0:(ldlm_lib.c:1898:abort_req_replay_queue()) @@@ aborted: req@00000000b5fc68c7 x1866818833682560/t0(8589934775) o101->7ad8772e-85be-4b66-acd8-b0f2382686d1@192.168.202.23@tcp:617/0 lens 592/0 e 0 to 0 dl 1780338182 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2840.237158] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2840.269911] Lustre: lustre-MDT0000: Denying connection for new client 7ad8772e-85be-4b66-acd8-b0f2382686d1 (at 192.168.202.23@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2840.275940] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2840.374437] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2840.374734] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2840.401140] Lustre: Skipped 2 previous similar messages [ 2840.455784] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:77 to 0x280000401:577) [ 2840.457247] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 2858.981049] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2858.994921] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2859.008742] Lustre: Skipped 1 previous similar message [ 2863.176465] Lustre: server umount lustre-OST0000 complete [ 2866.151842] LustreError: 97386:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2866.178039] LustreError: 97386:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 65 previous similar messages [ 2868.714846] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2868.720775] Lustre: Skipped 3 previous similar messages [ 2873.801186] Lustre: server umount lustre-OST0001 complete [ 2884.255679] Lustre: server umount lustre-MDT0000 complete [ 2888.207045] LustreError: 94313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780338219 with bad export cookie 5088317982633307660 [ 2888.213395] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2888.220496] LustreError: 94313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2888.653195] Lustre: server umount lustre-MDT0001 complete [ 2897.199770] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 14:23:46 (1780338226) [ 2905.202738] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2905.211638] Lustre: *** cfs_fail_loc=197, val=0*** [ 2920.802420] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2925.920465] LustreError: 98979:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.123@tcp: failed processing log, type 4: rc = -110 [ 2931.091167] Lustre: *** cfs_fail_loc=197, val=0*** [ 2931.093023] Lustre: Skipped 65 previous similar messages [ 2951.651118] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2951.661038] Lustre: Skipped 3 previous similar messages [ 2959.141618] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 2965.775415] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2968.660618] Lustre: server umount lustre-OST0000 complete [ 2979.112393] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 14:25:08 (1780338308) [ 3000.889839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3001.402586] LustreError: 100491:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3001.434429] LustreError: 100491:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 3006.367582] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3013.584726] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3017.100840] LustreError: 100522:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3017.108891] LustreError: 100522:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3017.113901] LustreError: 100522:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 16, retries 0, failed: rc = -5 [ 3017.409626] Lustre: server umount lustre-MDT0000 complete [ 3056.072362] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 3067.405457] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 3105.389329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3105.597546] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3105.654489] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3105.748628] Lustre: lustre-MDT0000: new disk, initializing [ 3105.851270] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3109.591100] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3118.906239] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3119.089798] Lustre: 104550:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3119.440433] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3123.806308] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3131.050701] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3134.443533] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3140.807360] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3141.052982] Lustre: 106293:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3146.026436] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3150.998940] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3154.169277] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3158.334419] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3158.532805] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3163.194064] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3163.457354] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3166.705754] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3166.707441] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3166.716679] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3166.716690] Lustre: Skipped 4 previous similar messages [ 3166.726641] Lustre: Skipped 6 previous similar messages [ 3166.759371] LustreError: Skipped 3 previous similar messages [ 3171.552409] Lustre: server umount lustre-OST0000 complete [ 3189.216346] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3191.415069] Lustre: server umount lustre-MDT0000 complete [ 3194.950841] LustreError: 106292:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780338526 with bad export cookie 5088317982633318216 [ 3194.956416] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3194.962059] LustreError: 106292:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3195.204390] Lustre: server umount lustre-MDT0001 complete [ 3204.393905] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 14:28:54 (1780338534) [ 3213.349872] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 3215.863873] Key type lgssc unregistered [ 3216.089677] LNet: 108618:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3216.097415] LNetError: 108618:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3216.116641] LNet: Removed LNI 192.168.202.123@tcp [ 3216.956242] Key type .llcrypt unregistered [ 3216.961471] Key type ._llcrypt unregistered [ 3236.729379] Key type ._llcrypt registered [ 3236.742465] Key type .llcrypt registered [ 3236.902691] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 3253.879471] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 3255.457934] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3255.505385] alg: No test for adler32 (adler32-zlib) [ 3256.683293] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 3256.943591] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 3258.627113] Key type lgssc registered [ 3260.070878] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3299.827151] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3299.891934] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3301.213738] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3301.260156] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3301.395891] Lustre: lustre-MDT0000: new disk, initializing [ 3301.510130] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3301.539137] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3305.458677] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3316.299953] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3316.541586] Lustre: lustre-OST0000: new disk, initializing [ 3316.548713] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3316.553907] Lustre: Skipped 1 previous similar message [ 3316.559746] Lustre: 112739:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3316.623347] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3323.725707] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3324.492492] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3324.507385] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3324.529463] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3335.895274] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3336.131276] Lustre: lustre-OST0001: new disk, initializing [ 3336.140652] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3336.149322] Lustre: 113586:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3336.241462] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3341.464662] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3341.478972] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3341.535566] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3342.954941] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3357.154351] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3357.176221] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3357.185523] Lustre: Skipped 1 previous similar message [ 3359.781378] Lustre: server umount lustre-MDT0000 complete [ 3367.104497] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3372.387331] LustreError: 111943:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780338703 with bad export cookie 5541906098404651136 [ 3372.397449] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3372.573869] Lustre: server umount lustre-OST0000 complete [ 3377.097666] Lustre: server umount lustre-OST0001 complete [ 3387.165387] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 14:31:57 (1780338717) [ 3398.753203] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 3422.934565] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 14:32:32 (1780338752) [ 3459.921890] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 3469.571442] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 3504.644238] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3504.928355] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3504.961795] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3505.070116] Lustre: lustre-MDT0000: new disk, initializing [ 3505.176254] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3505.216226] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3509.162447] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3519.418173] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3519.487974] Lustre: 120273:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3519.531223] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3519.535417] Lustre: Skipped 1 previous similar message [ 3519.591791] Lustre: lustre-MDT0001: new disk, initializing [ 3519.689038] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3519.732270] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3519.753845] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3524.162483] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3531.854841] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3535.475814] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3543.344048] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3543.636771] Lustre: lustre-OST0000: new disk, initializing [ 3543.641470] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3543.655564] Lustre: 122016:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3543.834184] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3550.962274] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3552.358833] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3552.377380] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3552.431930] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3558.993767] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3563.864210] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3564.138624] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3569.701363] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3569.945251] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3573.217253] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3573.222443] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3573.224100] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3573.235838] Lustre: Skipped 2 previous similar messages [ 3578.192709] Lustre: server umount lustre-OST0000 complete [ 3583.458524] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3583.470797] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3583.473910] Lustre: Skipped 1 previous similar message [ 3583.492293] Lustre: Skipped 2 previous similar messages [ 3588.578696] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3590.874786] Lustre: server umount lustre-MDT0000 complete [ 3594.651328] LustreError: 120263:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780338925 with bad export cookie 5541906098404652368 [ 3594.657073] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3594.663091] LustreError: 120263:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3595.059378] Lustre: server umount lustre-MDT0001 complete [ 3604.389056] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 14:35:34 (1780338934) [ 3610.767595] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3611.220705] LustreError: 124283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3611.239208] LustreError: 124283:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3611.310956] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3616.748334] LustreError: 124284:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3617.072558] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3620.838966] LustreError: 124283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3625.960674] LustreError: 124284:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3626.250124] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3632.296738] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3638.198915] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3642.035697] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3648.502436] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3648.915745] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3648.920117] Lustre: Skipped 1 previous similar message [ 3655.207721] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3661.728400] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3666.290235] Lustre: *** cfs_fail_loc=159, val=0*** [ 3666.300679] Lustre: Skipped 3 previous similar messages [ 3682.732079] Lustre: lustre-MDT0000: Client 1787537f-00ea-48af-b328-fae489d3209d (at 192.168.202.23@tcp) reconnecting [ 3684.870748] Lustre: *** cfs_fail_loc=159, val=0*** [ 3684.872790] Lustre: Skipped 2 previous similar messages [ 3701.147108] Lustre: lustre-MDT0000: Client 1787537f-00ea-48af-b328-fae489d3209d (at 192.168.202.23@tcp) reconnecting [ 3708.392712] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3708.432785] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3708.444976] LustreError: 126543:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3708.448979] LustreError: Skipped 1 previous similar message [ 3708.694974] Lustre: server umount lustre-OST0000 complete [ 3713.507300] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3713.514375] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3713.540244] Lustre: Skipped 1 previous similar message [ 3713.541531] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3713.541538] Lustre: Skipped 1 previous similar message [ 3718.637741] LustreError: 124284:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3718.670634] LustreError: 124284:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3718.765577] Lustre: server umount lustre-MDT0000 complete [ 3722.010627] LustreError: 124265:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339053 with bad export cookie 5541906098404653299 [ 3722.016836] LustreError: 124265:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3722.017675] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3722.294428] Lustre: server umount lustre-MDT0001 complete [ 3733.257309] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 3735.890938] Key type lgssc unregistered [ 3736.197678] LNet: 127706:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3736.203394] LNetError: 127706:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3736.228861] LNet: Removed LNI 192.168.202.123@tcp [ 3737.162717] Key type .llcrypt unregistered [ 3737.166756] Key type ._llcrypt unregistered [ 3765.207984] Key type ._llcrypt registered [ 3765.212456] Key type .llcrypt registered [ 3765.359874] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 3766.716909] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3766.805154] alg: No test for adler32 (adler32-zlib) [ 3767.830963] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 3767.965933] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 3769.624271] Key type lgssc registered [ 3770.570758] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3779.349436] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3779.375396] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3781.393566] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3787.735538] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3790.823614] LustreError: 129103:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3790.845154] LustreError: 129103:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3795.940402] LustreError: 129104:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3798.299561] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3798.710408] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3803.865239] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3810.860218] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3816.048620] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3823.974533] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3824.423857] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3826.475640] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3831.783321] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 3837.697785] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3851.200289] Lustre: *** cfs_fail_loc=159, val=0*** [ 3867.522133] Lustre: lustre-MDT0000: Client 68088622-f454-4780-abf3-5eb910635477 (at 192.168.202.23@tcp) reconnecting [ 3870.201767] Lustre: *** cfs_fail_loc=159, val=0*** [ 3886.506294] Lustre: lustre-MDT0001: Client 68088622-f454-4780-abf3-5eb910635477 (at 192.168.202.23@tcp) reconnecting [ 3888.689100] Lustre: *** cfs_fail_loc=159, val=0*** [ 3888.698432] Lustre: Skipped 3 previous similar messages [ 3904.974062] Lustre: lustre-MDT0001: Client 68088622-f454-4780-abf3-5eb910635477 (at 192.168.202.23@tcp) reconnecting [ 3911.711956] Lustre: 131807:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3914.820712] Lustre: *** cfs_fail_loc=159, val=0*** [ 3914.837734] Lustre: Skipped 4 previous similar messages [ 3931.018078] Lustre: lustre-MDT0000: Client 3909321c-2d72-4155-bd10-5bef2366a9af (at 192.168.202.23@tcp) reconnecting [ 3933.390764] Lustre: *** cfs_fail_loc=159, val=0*** [ 3933.401108] Lustre: Skipped 14 previous similar messages [ 3948.941757] Lustre: lustre-MDT0000: Client 3909321c-2d72-4155-bd10-5bef2366a9af (at 192.168.202.23@tcp) reconnecting [ 3951.143873] Lustre: 132096:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3957.257698] LustreError: lustre-OST0000-osc-MDT0001: operation ost_destroy to node 0@lo failed: rc = -107 [ 3957.258120] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3957.278083] LustreError: Skipped 1 previous similar message [ 3957.327855] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3959.780179] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3959.789332] LustreError: Skipped 1 previous similar message [ 3959.793341] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3959.807129] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3963.698870] Lustre: server umount lustre-OST0000 complete [ 3968.620298] Lustre: server umount lustre-MDT0000 complete [ 3971.061720] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3971.072507] LustreError: 131313:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3971.078420] Lustre: Skipped 1 previous similar message [ 3971.114404] LustreError: 131313:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3972.583862] LustreError: 129084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339303 with bad export cookie 4347918429789422751 [ 3972.590972] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3972.595719] LustreError: 129084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3975.128117] Lustre: server umount lustre-MDT0001 complete [ 3986.885448] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 3989.623663] Key type lgssc unregistered [ 3989.986817] LNet: 133135:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3989.992497] LNetError: 133135:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3990.006662] LNet: Removed LNI 192.168.202.123@tcp [ 3991.074792] Key type .llcrypt unregistered [ 3991.078617] Key type ._llcrypt unregistered [ 4018.216546] Key type ._llcrypt registered [ 4018.224332] Key type .llcrypt registered [ 4018.367357] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 4019.601351] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4019.623616] alg: No test for adler32 (adler32-zlib) [ 4020.719000] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 4020.948068] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 4022.680194] Key type lgssc registered [ 4024.164515] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4032.116901] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4032.134459] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4033.478609] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4038.181910] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4042.732064] LustreError: 134536:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4042.762792] LustreError: 134536:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4047.849379] LustreError: 134535:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4048.350808] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4048.877258] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4053.639539] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4060.229142] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4064.996923] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4072.505394] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4072.874525] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4073.913384] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4078.002744] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4080.517077] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4088.200302] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4095.478316] Lustre: 136781:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4099.065840] Lustre: 136830:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4100.636962] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4101.931976] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4106.121497] Lustre: 136977:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4107.314758] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4108.471307] Lustre: 137085:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4113.891532] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4113.894172] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4113.934189] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4113.945128] Lustre: Skipped 1 previous similar message [ 4119.014883] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4119.397620] Lustre: server umount lustre-OST0000 complete [ 4125.665927] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4125.676275] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4125.693098] Lustre: Skipped 1 previous similar message [ 4125.695882] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4125.701750] Lustre: Skipped 1 previous similar message [ 4129.251777] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4129.252846] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4129.283578] Lustre: Skipped 1 previous similar message [ 4130.843215] Lustre: server umount lustre-MDT0000 complete [ 4134.387810] LustreError: 135747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4134.408920] LustreError: 135747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4135.818746] LustreError: 134516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339467 with bad export cookie 11946472114229635432 [ 4135.822221] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4135.828026] LustreError: 134516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4136.230462] Lustre: server umount lustre-MDT0001 complete [ 4149.955768] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 4153.363984] Key type lgssc unregistered [ 4153.848734] LNet: 138124:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4153.862180] LNetError: 138124:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4153.905510] LNet: Removed LNI 192.168.202.123@tcp [ 4154.710836] Key type .llcrypt unregistered [ 4154.713520] Key type ._llcrypt unregistered [ 4181.145265] Key type ._llcrypt registered [ 4181.147758] Key type .llcrypt registered [ 4181.324599] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 4182.631854] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4182.668201] alg: No test for adler32 (adler32-zlib) [ 4183.855608] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 4184.019213] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 4185.664784] Key type lgssc registered [ 4186.347533] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4195.748812] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4195.772492] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4197.356250] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4201.585357] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4207.587241] LustreError: 139524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4207.612350] LustreError: 139524:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4211.925465] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4212.377421] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4218.601216] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4225.687455] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4230.646667] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4239.885575] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4240.152244] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4242.263817] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4249.553296] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4256.170695] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4257.601576] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4261.876714] Lustre: *** cfs_fail_loc=159, val=0*** [ 4278.157972] Lustre: lustre-MDT0000: Client f718f0c6-ba4d-435c-9c3d-5605b31eff1b (at 192.168.202.23@tcp) reconnecting [ 4296.709631] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4296.736863] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4301.509967] Lustre: server umount lustre-OST0000 complete [ 4306.917807] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4306.920109] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4306.936823] Lustre: Skipped 2 previous similar messages [ 4306.952665] Lustre: Skipped 2 previous similar messages [ 4312.033608] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4317.153439] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4317.156349] Lustre: Skipped 2 previous similar messages [ 4320.226804] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4320.543668] Lustre: server umount lustre-MDT0000 complete [ 4322.274196] LustreError: 141738:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4324.736797] LustreError: 139506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339656 with bad export cookie 5974013219066769901 [ 4324.739981] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4324.748595] LustreError: 139506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4325.492880] Lustre: server umount lustre-MDT0001 complete [ 4337.811439] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 4341.142099] Key type lgssc unregistered [ 4341.558818] LNet: 142840:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4341.565870] LNetError: 142840:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4341.589847] LNet: Removed LNI 192.168.202.123@tcp [ 4342.588602] Key type .llcrypt unregistered [ 4342.590550] Key type ._llcrypt unregistered [ 4373.489219] Key type ._llcrypt registered [ 4373.490976] Key type .llcrypt registered [ 4373.646918] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 4375.394887] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4375.431254] alg: No test for adler32 (adler32-zlib) [ 4376.583846] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 4376.936942] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 4378.745993] Key type lgssc registered [ 4379.946220] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4388.594924] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4388.633894] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4390.319913] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4395.344997] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4400.616046] LustreError: 144238:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4400.633728] LustreError: 144238:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4404.028668] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4404.493732] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4408.544162] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4414.832426] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4419.182544] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4426.651128] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4427.156996] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4429.251247] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4433.830573] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4435.391146] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4439.643573] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4460.561242] Lustre: lustre-OST0000: evicting 4a9976df-4ea5-4d06-afc3-e79c20cb4bb8 (at 192.168.202.23@tcp) by administrative request [ 4460.574112] Lustre: Skipped 1 previous similar message [ 4491.766964] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4491.769469] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4491.772318] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4491.781179] Lustre: Skipped 1 previous similar message [ 4491.818227] Lustre: Skipped 1 previous similar message [ 4496.884908] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4496.903613] Lustre: Skipped 1 previous similar message [ 4497.176723] Lustre: server umount lustre-OST0000 complete [ 4501.989571] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4501.992606] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4502.008582] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4502.053620] Lustre: Skipped 1 previous similar message [ 4507.107111] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4507.118406] Lustre: Skipped 2 previous similar messages [ 4508.554618] Lustre: server umount lustre-MDT0000 complete [ 4512.230911] LustreError: 145264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4512.269336] LustreError: 145264:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4513.440982] LustreError: 144219:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780339844 with bad export cookie 14825762224411426209 [ 4513.455069] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4513.456597] LustreError: 144219:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4514.082330] Lustre: server umount lustre-MDT0001 complete [ 4526.976289] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 4530.396339] Key type lgssc unregistered [ 4530.780433] LNet: 147954:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4530.787046] LNetError: 147954:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4531.824441] LNet: Removed LNI 192.168.202.123@tcp [ 4532.937931] Key type .llcrypt unregistered [ 4532.939922] Key type ._llcrypt unregistered [ 4623.666497] Key type ._llcrypt registered [ 4623.671795] Key type .llcrypt registered [ 4623.823298] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 4625.172239] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4625.361855] alg: No test for adler32 (adler32-zlib) [ 4626.686346] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 4627.004855] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 4628.824200] Key type lgssc registered [ 4630.947078] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4639.225827] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4639.247400] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4641.034078] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4645.530554] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4651.508483] LustreError: 150429:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4651.540273] LustreError: 150429:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4655.911239] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4656.425141] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4661.237726] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4667.794964] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4671.764680] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4678.920558] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4679.421146] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4681.477624] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4686.324459] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4686.603812] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4693.187426] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4702.178237] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4702.181292] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4702.195527] LustreError: Skipped 1 previous similar message [ 4702.197584] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4702.221835] Lustre: Skipped 1 previous similar message [ 4702.252651] Lustre: Skipped 1 previous similar message [ 4707.302365] LustreError: 152031:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4707.323552] LustreError: 152031:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4707.427532] Lustre: server umount lustre-OST0000 complete [ 4712.420963] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4712.427191] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4712.445693] Lustre: Skipped 1 previous similar message [ 4712.473512] Lustre: Skipped 1 previous similar message [ 4717.540598] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4717.548320] Lustre: Skipped 1 previous similar message [ 4722.660278] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4722.674462] Lustre: Skipped 1 previous similar message [ 4726.240706] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4726.485474] Lustre: server umount lustre-MDT0000 complete [ 4727.777262] LustreError: 150429:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4727.815087] LustreError: 150429:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4730.578685] LustreError: 150411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780340061 with bad export cookie 3223062270720194226 [ 4730.585147] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4730.589409] LustreError: 150411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4730.966075] Lustre: server umount lustre-MDT0001 complete [ 4743.005281] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 4746.727782] Key type lgssc unregistered [ 4747.154092] LNet: 153616:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4747.162060] LNetError: 153616:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4747.181296] LNet: Removed LNI 192.168.202.123@tcp [ 4748.244101] Key type .llcrypt unregistered [ 4748.245271] Key type ._llcrypt unregistered [ 4778.053123] Key type ._llcrypt registered [ 4778.056142] Key type .llcrypt registered [ 4778.202447] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 4779.575879] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4779.751086] alg: No test for adler32 (adler32-zlib) [ 4780.890184] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 4781.209510] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 4782.993121] Key type lgssc registered [ 4784.342820] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4801.432168] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 14:55:31 (1780340131) [ 4820.650894] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 4833.737559] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 4875.639212] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4875.666466] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4877.015314] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4877.094792] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4877.204274] Lustre: lustre-MDT0000: new disk, initializing [ 4877.335153] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4877.361291] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4881.843270] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4894.296613] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4894.563390] Lustre: 157832:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4894.739631] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4894.746149] Lustre: Skipped 1 previous similar message [ 4894.867918] Lustre: lustre-MDT0001: new disk, initializing [ 4895.076837] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4895.128851] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4895.172353] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4903.517557] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4917.229737] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4922.262791] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4931.274803] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4931.567722] Lustre: lustre-OST0000: new disk, initializing [ 4931.571708] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4931.582902] Lustre: 159582:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4931.719837] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4939.618366] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 4940.882219] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4940.897470] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4941.089915] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4947.162847] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4961.762376] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4961.773477] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4961.781155] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4961.787907] Lustre: Skipped 1 previous similar message [ 4963.328138] Lustre: server umount lustre-OST0000 complete [ 4972.005078] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4972.016409] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4972.034026] Lustre: Skipped 1 previous similar message [ 4972.035927] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4972.066391] LustreError: Skipped 1 previous similar message [ 4975.946952] Lustre: server umount lustre-MDT0000 complete [ 4979.743949] LustreError: 157827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780340311 with bad export cookie 15174788322550123701 [ 4979.762415] LustreError: 157827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4979.762770] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4980.090438] Lustre: server umount lustre-MDT0001 complete [ 4992.413066] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 4995.970618] Key type lgssc unregistered [ 4996.411166] LNet: 161358:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4996.424646] LNetError: 161358:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4996.449510] LNet: Removed LNI 192.168.202.123@tcp [ 4997.622482] Key type .llcrypt unregistered [ 4997.625455] Key type ._llcrypt unregistered [ 5030.483791] Key type ._llcrypt registered [ 5030.485397] Key type .llcrypt registered [ 5030.675355] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 5032.392800] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5032.452643] alg: No test for adler32 (adler32-zlib) [ 5034.041637] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 5034.361958] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 5036.136573] Key type lgssc registered [ 5038.061319] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5048.477996] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5048.494458] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5050.370258] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5056.034104] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 5060.591413] LustreError: 162759:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5060.616558] LustreError: 162759:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5065.702745] LustreError: 162758:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5066.216198] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5066.880908] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5072.885951] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 5080.189838] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5084.986057] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5093.356392] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5093.857348] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5094.919429] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5100.870444] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 5107.743594] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5119.041687] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5119.054962] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5119.093882] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5119.104806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.120549] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5120.137156] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5120.162074] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5120.170270] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5120.179748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.195684] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5121.443064] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5121.459754] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5121.468248] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5121.472445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.478685] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5122.315700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.428875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.587663] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5124.597131] Lustre: Skipped 2 previous similar messages [ 5124.612142] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5124.630497] Lustre: Skipped 2 previous similar messages [ 5124.635193] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5124.647145] Lustre: Skipped 2 previous similar messages [ 5124.653516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.668341] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5124.677658] Lustre: Skipped 2 previous similar messages [ 5125.543131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.844413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.859039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.799615] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5128.803499] Lustre: Skipped 3 previous similar messages [ 5128.814566] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5128.822289] Lustre: Skipped 3 previous similar messages [ 5128.824841] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5128.828809] Lustre: Skipped 3 previous similar messages [ 5128.831810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.839780] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5128.842653] Lustre: Skipped 3 previous similar messages [ 5129.645206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.040049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.990686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.998441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5133.877517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.963551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.806753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.799958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.690771] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5137.694682] Lustre: Skipped 8 previous similar messages [ 5137.721451] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5137.731731] Lustre: Skipped 8 previous similar messages [ 5137.736650] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5137.738654] Lustre: Skipped 8 previous similar messages [ 5137.743830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.772216] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5137.775677] Lustre: Skipped 8 previous similar messages [ 5138.913406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.905343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.329108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.297545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.214671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.151364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.374904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.494634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.451595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.574531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.576477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.736540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.190675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.346171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.364214] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5154.375041] Lustre: Skipped 14 previous similar messages [ 5154.392842] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5154.399728] Lustre: Skipped 14 previous similar messages [ 5154.409590] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5154.416208] Lustre: Skipped 14 previous similar messages [ 5154.418785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.448528] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5154.450766] Lustre: Skipped 14 previous similar messages [ 5155.463907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.457224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.417435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.162258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.090200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.480390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.829258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.930332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.410864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.712666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.987591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.451368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.357717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.423409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.360086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.703496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.822282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.848494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.212385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.384451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.499634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.522324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.751550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.688653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.662901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.543932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.742846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.735180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.601494] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5186.607223] Lustre: Skipped 28 previous similar messages [ 5186.619283] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5186.626068] Lustre: Skipped 28 previous similar messages [ 5186.629705] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5186.633616] Lustre: Skipped 28 previous similar messages [ 5186.635933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.640444] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5186.646301] Lustre: Skipped 28 previous similar messages [ 5187.661252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.787341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.828026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.866338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.844868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.101761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.295604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.338979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.554558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.414927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.585720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.697211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.042344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5202.279399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.390337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5204.236878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.411356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.356917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.593683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.530909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.645853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.750810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.409359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.914807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.109518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.333287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.589758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.193485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.535831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.049847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.317108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.620280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.051590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.383809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.683090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.067654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.722556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.937408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.454122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.778453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.781863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.888734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.098842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.059653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.204699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.110817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.044295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.775940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.623779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.613054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.851591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.804550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.230356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.203752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.217199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.947292] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5250.948941] Lustre: Skipped 55 previous similar messages [ 5250.960570] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5250.964536] Lustre: Skipped 55 previous similar messages [ 5250.966564] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5250.968712] Lustre: Skipped 55 previous similar messages [ 5250.978148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.982744] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5250.986750] Lustre: Skipped 55 previous similar messages [ 5251.667691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.724631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.975366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.303257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.255326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.260329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.071759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.914574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.072772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.553117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.882388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.334827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.890479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.995069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.986197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.212807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.147480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.599500] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5271.613571] LustreError: 162778:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5271.637748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.785545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.009764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.436697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.626604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.768946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.551404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.370613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.439755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.433988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.506440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.268345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.507154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.203428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5286.118072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5286.855112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.090979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.485279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5291.014788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.380755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.851590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.373589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.739511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.817315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.818959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.968946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5301.145235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.341255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.466121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.691424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.902942] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5305.917209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.920316] LustreError: 162778:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5307.340343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.543339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.901390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.204549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.510736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.608909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.826621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.962550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.932764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5318.209419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.534372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.119708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.378844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.431666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.534425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.148584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.352347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.454622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.173080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.465410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.392610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.652563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.680033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.543336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.433841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.322592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5338.555824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.890136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.956640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.165303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.401454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.140764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.360804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.577275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.447504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5348.257955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.446322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.147047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.996305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.994539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.410952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.267953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.277646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.001840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.889045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.964895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.306161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.638747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5361.736891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.976814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.339665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5365.551425] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5365.565993] LustreError: 162778:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5365.582785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.770841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.784085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.935615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.100334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.563406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.000963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.189359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.488588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.583855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.597315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5378.854204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5380.053507] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5380.069686] Lustre: Skipped 111 previous similar messages [ 5380.115111] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5380.134639] Lustre: Skipped 111 previous similar messages [ 5380.145979] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5380.156519] Lustre: Skipped 111 previous similar messages [ 5380.168716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5380.197982] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5380.220991] Lustre: Skipped 111 previous similar messages [ 5381.317900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.417385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5383.764957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.792425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.860533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.190727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5388.176188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.367913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.495768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.762081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5392.842962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5393.794556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5394.961453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.932479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.838249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5397.869654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.812498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.746896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.748615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.856986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5403.016621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5404.047390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.129101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.252187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.203741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.068410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.080725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5410.332378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.310642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.291803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5413.427506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.513265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.501318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.605331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.708137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5418.762075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.832689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.975514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5421.905466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.208882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.391546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5425.651182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.886201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.927883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.089928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.280735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.659240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.583152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.419175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.008753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.282990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.400810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.695583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.002791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.386485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.102863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.369197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.719635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.212524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.660638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.265044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5450.676202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.800502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.192614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5454.501638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.090596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.987624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.216942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5459.338846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.186964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.381180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.307601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.475674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.449171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.708912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.045751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.924185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.658477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.453594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.379428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.195876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.682847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.292237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.197315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5476.034884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5477.603151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.987592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.038468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.341996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.417226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.631553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.659761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.892445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.056880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.124551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.312859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.545024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.554729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.693213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.554687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.682252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.503398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.800996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.821393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.973865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.209378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.433448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.380579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.544871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.460682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.407250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.395559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.348182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.292305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.533989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.225800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.012837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.616620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.373421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.378431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.625029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.658298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.078967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.268395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.980259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.699219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.883818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.547246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.536809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.397907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.542603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.680226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.526235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.546922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.309843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.242309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.916218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5530.893791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.120061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.465604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.635442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.894024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.586486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.784072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.187073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.399328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.931508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.950121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.545113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.499332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.544096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.628414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.804834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.961494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.733647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.541359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.230264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.578553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.178876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.514617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.096307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.523979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.109772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.490518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.826924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.223955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.812544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.247499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.585599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.705774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.113785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.261633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.380784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.273258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.967047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.741191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.040774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.457370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.253255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.667110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.583380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.721217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.908152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.252433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.988629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.930815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.039149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.008135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.887948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.948294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.134233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.043949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.329228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.556522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.399112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.392121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.365318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.665501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.665601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.042683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.038380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.068913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.912584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.974198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.827702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.830089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.633092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.825838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.930807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.877189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.997313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.994641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.175482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.853611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.811769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.127402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.137833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.082082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.130701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.095214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.808966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.795972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.849290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.169385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.403964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.632098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.590853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.717245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.882367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.946080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.170852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.319203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.243730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.541225] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5636.545780] Lustre: Skipped 233 previous similar messages [ 5636.569627] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5636.586415] Lustre: Skipped 233 previous similar messages [ 5636.596328] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5636.600016] Lustre: Skipped 233 previous similar messages [ 5636.601629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.615299] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5636.620831] Lustre: Skipped 233 previous similar messages [ 5637.809335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.827605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.113475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.197408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.021544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.982284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.075880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.355887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.343613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.571660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.079312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.468674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.627677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.025947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.386027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.515202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.855635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.079480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.166245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.518507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.469467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.574970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.516655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.698396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.810982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.899455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.039882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.030973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.071671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.002627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.046913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.916227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.911803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.779528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.998717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.068620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.342034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.451383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.478342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.782198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.176919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.446607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.548868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.740163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.748926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.018759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.336235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.297603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.503559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.366370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.608443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.898645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.057420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.164067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.426206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.581988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.807055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.711079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.651878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.562086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.404355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.274435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.880486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.212463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.256087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.444906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.291048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.074027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.056807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.984348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.932040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.046217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.482513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.135518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.831324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.090460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.314081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.439343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.693206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5726.818782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.164937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.352585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.460215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.844375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.192204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.362049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.778528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.774610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.876221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.800881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.295287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.709110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.920494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.196929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.176859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.676556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.858863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.862051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.999767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.215768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.607254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5753.770714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.052589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.367561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.318512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.056416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.561758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.994927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5763.216688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.652384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5766.014977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.208690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.354516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.691913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.879690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.623944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5772.981450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.296660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.494298] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5775.505049] LustreError: 162778:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5775.505985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.400342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.406446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.770347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.648191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.700035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.070062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.481493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.913078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.193076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.380037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5788.548938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5789.812021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.952570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.084577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.225816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.401445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5795.648360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.043601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.331074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.576688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.686357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.915720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5803.018650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.246909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.219083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.429334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.759459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.108879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.193971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.518353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.766749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.991533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.372689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.457462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.652579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.900100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.075755] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5820.097224] LustreError: 162778:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5820.107267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.369536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.468330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.545193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.233207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.286460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.194511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.687294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.886274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.241100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.395328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.005571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.301029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.511963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.625402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.915375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.297885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5840.173710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.230292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.317860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.624271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.586648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.739117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.752265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.997220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.843979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.963534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5851.007666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.121479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.153577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.196227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.212512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5856.689846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.941116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.286989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.421988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.438688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.644573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5863.602317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.702659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5865.630444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.763046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5867.698629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.744142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5869.719711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.734766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5871.795806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.606520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.597766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.646154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.831502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5876.899903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.962065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.167554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5880.359217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.307527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.405517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5883.564908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5884.555595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.658871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.580752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.541951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5888.579762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.818171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.824462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.966719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.807883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5893.940652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.847578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.932296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5897.077557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.348746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.190995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5900.179413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.268964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.276514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5903.254539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.244098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5905.336223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.214311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.082902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.854794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5908.635440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.407430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.235430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.947955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5911.793175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5912.622047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.769141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.578638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5915.748084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5916.637613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5917.808080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.709874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5919.840427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5920.735283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.806465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.677794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.705773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.577770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.503897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5926.485740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.452922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.476963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.417324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5930.348770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.298514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5932.201595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.059767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.785740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.671180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.635513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5936.692321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.795714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.778410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.791073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.502967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.331977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.196013] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.972085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.713601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.555454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.551838] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5945.566867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.572299] LustreError: 162778:0:(osp_precreate.c:1356:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5946.404984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.178733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.041951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.895596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5949.699093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.637130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5951.558169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.480681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.482752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.395393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5955.272360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.166957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.931349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5957.943337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.671966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.438174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5960.181972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.106696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.989577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.092758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.905471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.754903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.504522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.325988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5967.215493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.103126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.832306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.735095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.674074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.688585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.554845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.571259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5974.516186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.683453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.572093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.510581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.404778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.528801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.315936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.224682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.215375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.155555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.087984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.975866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5985.760851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.642870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.436155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.302097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.309546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.302078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.185453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.008916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.921412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.912911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.913488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.054310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.888746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.038373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.820479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5999.840406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.660208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.833391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6002.863096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.002387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6005.117448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.091100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.150387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6008.171574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.217514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.267377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.351928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.393760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.332924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6014.355395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.290203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.286151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.203382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6018.198050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.111412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.151856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.005972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.988189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.806401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6023.785344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.471463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.365618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.227970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.106511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.773942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.463535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.310827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.967122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6030.643397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.363089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.233186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.089330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.163980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.158577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.305079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.282911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6038.231575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.378214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6040.347513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.410468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.288751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.346692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.106345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.932901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6045.856387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.900695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.762465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.897233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.962112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.864430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.894715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6052.832891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6053.916642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.909459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.104043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.081645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.133304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.024840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.932728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.820834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.671293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.629594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.470268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6064.402778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.187926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.166552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.065379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.010320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.135908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.031620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.065275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.926476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.979650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6073.869239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.817442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6075.770247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.002435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.685980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.625935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6079.518539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.488509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.237746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.102869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.989449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.870361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.562935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.469501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6086.342993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.215170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.952298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.803912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6089.654381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.669332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.549321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.397743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.325247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.510234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6095.591912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.585929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6097.371240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.087939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.973507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6099.761858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.576679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.401585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.314075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.174703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.939514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6104.759725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.557244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.374669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.132348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.963048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.859281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.788546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.679502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.481320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.375883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6113.170588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.118401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.972558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.851673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6116.613332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.557495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.371394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.318600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.285995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.186213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.924170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.771558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.563574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6124.602380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.429580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.485752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.469418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6128.423506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.373864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6130.341387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.098532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.937073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6132.575158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.424231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6134.285861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6135.286968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6136.084884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6137.123322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6138.138575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6139.269894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.072047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.878782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.719811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6142.554397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.292891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6144.181320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6144.920601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6145.775879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6146.659116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6147.496629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.513222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.414476] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6149.418964] Lustre: Skipped 501 previous similar messages [ 6149.441172] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6149.447073] Lustre: Skipped 501 previous similar messages [ 6149.451359] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6149.454716] Lustre: Skipped 501 previous similar messages [ 6149.457713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.471358] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6149.476945] Lustre: Skipped 501 previous similar messages [ 6150.352906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.190449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.062424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.936935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6153.773395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.675082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.524743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6156.441504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6157.242144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.002917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.704467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.531811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6160.198388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6160.998498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6161.693727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.591332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.512876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6164.543197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.314308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.079043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.882970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.659107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6168.486240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.455264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.388494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.005437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.661366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6172.472778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.452240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6174.204674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6175.226481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.183761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.046419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6502.699380] LustreError: 173798:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6502.707845] LustreError: 162778:0:(osp_precreate.c:652:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6826.353710] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 6826.354368] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6826.356484] LustreError: Skipped 2 previous similar messages [ 6826.364317] Lustre: Skipped 33 previous similar messages [ 6826.369511] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6827.490739] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6827.502151] LustreError: Skipped 2 previous similar messages [ 6827.507422] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6829.545354] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6829.548827] Lustre: Skipped 1 previous similar message [ 6832.570030] Lustre: server umount lustre-OST0000 complete [ 6838.241283] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6838.252133] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6841.466974] Lustre: server umount lustre-MDT0000 complete [ 6843.920538] LustreError: 162738:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342175 with bad export cookie 3204941066141629354 [ 6843.923909] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6843.934684] LustreError: 162738:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6844.193535] Lustre: server umount lustre-MDT0001 complete [ 6851.542421] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 6853.594902] Key type lgssc unregistered [ 6853.882086] LNet: 217627:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6853.884769] LNetError: 217627:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6853.900035] LNet: Removed LNI 192.168.202.123@tcp [ 6854.567408] Key type .llcrypt unregistered [ 6854.570806] Key type ._llcrypt unregistered [ 6871.190640] Key type ._llcrypt registered [ 6871.193416] Key type .llcrypt registered [ 6871.272907] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 6872.109232] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6872.125179] alg: No test for adler32 (adler32-zlib) [ 6873.089540] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 6873.276176] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 6874.912244] Key type lgssc registered [ 6875.732466] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6880.643299] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6880.656701] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6882.000485] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6884.885853] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 6890.334958] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6890.560038] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6893.238280] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 6896.814994] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6899.265204] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6903.681144] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6903.911204] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6906.994954] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 6908.717593] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 6912.443994] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6920.617991] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6921.778186] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6921.786614] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6921.789495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6921.801777] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6921.802658] LustreError: 219023:0:(osp_precreate.c:1264:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6925.155745] Lustre: lustre-OST0000: Not available for connect from 192.168.202.23@tcp (stopping) [ 6925.799795] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6925.807414] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6925.821414] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6927.841652] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6927.842951] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6929.161675] Lustre: server umount lustre-OST0000 complete [ 6941.808273] LustreError: 219023:0:(osp_precreate.c:1264:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6959.536342] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6959.744696] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6963.379839] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 6967.007663] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6967.915619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6967.940879] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6968.142323] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6970.734383] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff936a08592000.ost_server_uuid 50 [ 6971.656294] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff936a08592000.ost_server_uuid in FULL state after 0 sec [ 6977.762818] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6977.771334] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6977.782059] Lustre: Skipped 2 previous similar messages [ 6979.827879] Lustre: server umount lustre-OST0000 complete [ 6982.629640] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6982.636598] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6982.651405] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6988.133323] Lustre: server umount lustre-MDT0000 complete [ 6988.256928] LustreError: 219003:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6988.264923] LustreError: 219003:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6990.349694] LustreError: 218985:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342321 with bad export cookie 4987770394707950172 [ 6990.353628] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6990.359556] LustreError: 218985:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6990.528823] Lustre: server umount lustre-MDT0001 complete [ 6996.795854] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 6998.385613] Key type lgssc unregistered [ 6998.569598] LNet: 223637:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6998.576605] LNetError: 223637:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6998.583565] LNet: Removed LNI 192.168.202.123@tcp [ 6998.970149] Key type .llcrypt unregistered [ 6998.971869] Key type ._llcrypt unregistered [ 7016.278290] Key type ._llcrypt registered [ 7016.280450] Key type .llcrypt registered [ 7016.344931] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7016.912786] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7016.921808] alg: No test for adler32 (adler32-zlib) [ 7017.855187] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 7017.977913] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 7019.600582] Key type lgssc registered [ 7020.254043] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7025.261773] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7025.273032] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7026.535416] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7028.509292] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7032.724314] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7032.899901] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7034.872876] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7036.550700] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7039.942943] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7040.146364] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7043.149406] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7048.026209] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7048.128126] Lustre: lustre-OST0001: new disk, initializing [ 7048.130860] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7048.134758] Lustre: 227579:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7048.185913] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7051.245509] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 7051.319880] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7051.330432] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7051.399801] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7051.450842] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7058.335397] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7064.075225] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7072.229017] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7072.231361] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7072.234326] Lustre: Skipped 1 previous similar message [ 7072.237019] Lustre: Skipped 1 previous similar message [ 7074.300077] Lustre: server umount lustre-MDT0000 complete [ 7076.348061] LustreError: 227578:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342407 with bad export cookie 8372123289516943386 [ 7076.349906] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7076.352435] LustreError: 226045:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 7076.355187] LustreError: 227578:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7076.527243] Lustre: server umount lustre-MDT0001 complete [ 7089.070828] Lustre: server umount lustre-OST0000 complete [ 7101.780832] Lustre: server umount lustre-OST0001 complete [ 7113.955893] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7120.079094] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7120.366841] LustreError: 230661:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7120.376191] LustreError: 230661:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7120.423331] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7122.535935] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7125.473775] LustreError: 230662:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7127.274613] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7129.712122] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7131.454515] Lustre: 231771:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7135.561500] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7135.733475] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7135.738731] Lustre: Skipped 1 previous similar message [ 7136.741232] LustreError: 232265:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7136.744038] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 7138.475588] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7141.859521] LustreError: 232265:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7142.571184] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7144.758412] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 7144.760409] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 7145.619751] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7150.026415] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7151.993255] Lustre: 233608:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7158.242691] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7158.246126] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7158.250851] Lustre: Skipped 1 previous similar message [ 7158.260547] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7160.029368] Lustre: server umount mylustre-MDT0000 complete [ 7160.292344] Lustre: mylustre-MDT0000-lwp-OST0000: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7160.292525] LustreError: 230662:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7160.299373] Lustre: Skipped 2 previous similar messages [ 7160.307610] LustreError: 230662:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7161.801443] LustreError: 230637:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342493 with bad export cookie 8372123289516946235 [ 7161.806522] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7161.814348] LustreError: 230637:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7161.988213] Lustre: server umount mylustre-MDT0001 complete [ 7174.736298] Lustre: server umount mylustre-OST0000 complete [ 7186.815936] Lustre: server umount mylustre-OST0001 complete [ 7198.518589] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7204.106431] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7204.322200] LustreError: 235898:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7204.370208] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7204.375525] Lustre: Skipped 1 previous similar message [ 7206.835259] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7211.885955] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7214.802207] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7216.670297] Lustre: 237008:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7220.938428] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7222.124759] LustreError: 237360:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7222.135539] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 7222.149521] LustreError: 237360:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7223.848978] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7228.006228] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7229.174975] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 7229.175098] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 7230.737408] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7235.090632] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7237.203412] Lustre: 238844:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7242.721634] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7242.728767] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7242.744932] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7244.772338] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7246.457781] Lustre: server umount tfs-MDT0000 complete [ 7248.312974] LustreError: 235875:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342579 with bad export cookie 8372123289516948412 [ 7248.318196] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7248.322217] LustreError: 235875:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7248.491122] Lustre: server umount tfs-MDT0001 complete [ 7259.788916] Lustre: server umount tfs-OST0000 complete [ 7270.863279] Lustre: server umount tfs-OST0001 complete [ 7281.907461] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7286.594086] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7286.814720] LustreError: 241071:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7286.826123] LustreError: 241071:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7286.852412] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7286.855336] Lustre: Skipped 3 previous similar messages [ 7288.713861] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7292.848221] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7295.019991] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7296.604923] Lustre: 242183:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7299.728188] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7302.618356] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7302.951644] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 7306.318579] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7309.564247] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7311.851655] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 7312.878454] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 7318.516726] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7319.996601] Lustre: 244014:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7322.819361] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 15:37:33 (1780342653) [ 7338.466544] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7338.470276] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7338.472768] Lustre: Skipped 5 previous similar messages [ 7338.475603] Lustre: Skipped 4 previous similar messages [ 7341.231754] Lustre: server umount lustre-MDT0000 complete [ 7342.994211] LustreError: 241802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342674 with bad export cookie 8372123289516950330 [ 7342.999217] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7343.004406] LustreError: 241802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7347.617965] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7347.620075] Lustre: Skipped 3 previous similar messages [ 7349.238539] Lustre: server umount lustre-MDT0001 complete [ 7357.003465] Lustre: server umount lustre-OST0000 complete [ 7373.280139] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7373.361114] Lustre: server umount lustre-OST0001 complete [ 7375.958259] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 7379.675472] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7395.876492] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7395.876492] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7395.876492] [ 7395.883150] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7396.009132] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7396.029960] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7396.074487] Lustre: lustre-MDT0000: new disk, initializing [ 7396.133359] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7396.136509] Lustre: Skipped 3 previous similar messages [ 7396.144738] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7398.427687] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7405.065672] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 7405.065672] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7405.065672] [ 7405.084870] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7405.148585] Lustre: 247157:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7405.193127] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7405.203527] Lustre: Skipped 1 previous similar message [ 7405.260662] Lustre: lustre-MDT0001: new disk, initializing [ 7405.367824] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7405.377310] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7407.785840] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7413.028919] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7413.203300] Lustre: lustre-OST0000: new disk, initializing [ 7413.205666] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7413.208854] Lustre: 248706:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7414.811023] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7414.819452] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7414.872592] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7415.857428] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7420.956647] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7421.032902] Lustre: lustre-OST0001: new disk, initializing [ 7421.034799] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7421.038229] Lustre: 249560:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7422.093826] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7422.097317] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7422.143126] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7423.586455] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7429.370956] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 15:39:19 (1780342759) [ 7434.035497] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 15:39:24 (1780342764) [ 7448.038508] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7448.039767] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7448.044291] Lustre: Skipped 4 previous similar messages [ 7460.320145] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7460.400936] Lustre: server umount lustre-OST0000 complete [ 7463.400287] LustreError: 248691:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7463.410741] LustreError: 248691:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 7468.521212] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7468.588120] Lustre: server umount lustre-MDT0000 complete [ 7473.635830] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7473.643801] Lustre: Skipped 3 previous similar messages [ 7476.952710] Lustre: server umount lustre-MDT0001 complete [ 7481.605818] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 7493.483276] Lustre: server umount lustre-OST0001 complete [ 7496.529991] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 7504.852468] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7539.445284] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7539.762533] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7539.793570] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7539.849770] Lustre: lustre-MDT0000: new disk, initializing [ 7539.982929] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7539.994544] Lustre: Skipped 3 previous similar messages [ 7540.023164] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7545.859619] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7556.982717] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7557.114594] Lustre: 254027:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7557.167449] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7557.171532] Lustre: Skipped 1 previous similar message [ 7557.279088] Lustre: lustre-MDT0001: new disk, initializing [ 7557.497038] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7557.527779] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7561.171687] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7571.540689] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7575.287777] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7583.940832] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7584.171772] Lustre: 255766:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7585.433614] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7585.637153] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7590.079428] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7595.505926] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7601.122195] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7601.127918] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7601.148603] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7601.156254] Lustre: Skipped 10 previous similar messages [ 7606.243787] Lustre: server umount lustre-OST0000 complete [ 7623.137693] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7623.275377] Lustre: server umount lustre-MDT0000 complete [ 7626.036082] LustreError: 254017:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780342957 with bad export cookie 8372123289516953613 [ 7626.049164] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7626.326519] Lustre: server umount lustre-MDT0001 complete [ 7635.999737] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 7638.033886] Key type lgssc unregistered [ 7638.254730] LNet: 257396:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7638.260931] LNetError: 257396:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7638.272666] LNet: Removed LNI 192.168.202.123@tcp [ 7638.980254] Key type .llcrypt unregistered [ 7638.983205] Key type ._llcrypt unregistered [ 7659.734781] Key type ._llcrypt registered [ 7659.736677] Key type .llcrypt registered [ 7659.815324] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7660.672611] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7660.720979] alg: No test for adler32 (adler32-zlib) [ 7661.863410] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 7662.037940] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 7663.696168] Key type lgssc registered [ 7664.736953] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7670.624265] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7670.647133] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7672.021959] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7675.224660] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7682.283770] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7682.548421] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7685.904192] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7690.032996] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7692.547806] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7697.572971] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7697.803838] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7698.859199] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 7702.542166] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7706.820922] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7707.716272] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7709.154694] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7709.158593] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7709.165453] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7713.256104] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7713.260746] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7713.265158] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7713.289402] Lustre: Skipped 1 previous similar message [ 7715.371572] Lustre: server umount lustre-OST0000 complete [ 7718.370296] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7718.370661] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7718.382513] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7723.489257] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7723.491646] Lustre: Skipped 2 previous similar messages [ 7724.306600] Lustre: server umount lustre-MDT0000 complete [ 7727.116228] LustreError: 258800:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780343058 with bad export cookie 10640519463551873783 [ 7727.125715] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7727.421917] Lustre: server umount lustre-MDT0001 complete [ 7735.145433] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 7737.289172] Key type lgssc unregistered [ 7737.529466] LNet: 262045:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7737.535662] LNetError: 262045:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7738.600636] LNet: Removed LNI 192.168.202.123@tcp [ 7739.201205] Key type .llcrypt unregistered [ 7739.202966] Key type ._llcrypt unregistered [ 7751.109251] Key type ._llcrypt registered [ 7751.110624] Key type .llcrypt registered [ 7751.182295] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7751.856793] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7752.014645] alg: No test for adler32 (adler32-zlib) [ 7752.999208] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 7753.178142] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 7754.816267] Key type lgssc registered [ 7755.673723] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7762.616861] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7762.635797] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7778.208824] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7783.328585] LustreError: 263200:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.123@tcp: failed processing log, type 4: rc = -110 [ 7809.952331] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7814.501833] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 7819.097288] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7821.089370] Lustre: server umount lustre-OST0000 complete [ 7833.346463] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 7835.457364] Key type lgssc unregistered [ 7835.724804] LNet: 264703:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7835.735582] LNetError: 264703:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7835.771179] LNet: Removed LNI 192.168.202.123@tcp [ 7836.409169] Key type .llcrypt unregistered [ 7836.411296] Key type ._llcrypt unregistered [ 7866.040370] Key type ._llcrypt registered [ 7866.041661] Key type .llcrypt registered [ 7866.129470] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 7866.678802] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7866.751627] alg: No test for adler32 (adler32-zlib) [ 7867.807680] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 7867.998885] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 7869.648082] Key type lgssc registered [ 7870.510497] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7882.447168] loop0: detected capacity change from 0 to 204800000 [ 7882.547466] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7882.556289] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7882.855538] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7884.013100] loop0: detected capacity change from 0 to 204800000 [ 7884.271774] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7884.288275] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7884.883717] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7886.142959] loop0: detected capacity change from 0 to 204800000 [ 7886.396120] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7886.415308] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7886.510948] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7887.506948] loop0: detected capacity change from 0 to 204800000 [ 7887.682844] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7887.707727] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7887.802623] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7888.917991] loop0: detected capacity change from 0 to 204800000 [ 7888.985164] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7892.875726] loop0: detected capacity change from 0 to 204800000 [ 7892.912310] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7896.199910] loop0: detected capacity change from 0 to 204800000 [ 7896.238154] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7899.196259] loop0: detected capacity change from 0 to 204800000 [ 7899.216657] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7902.273855] loop0: detected capacity change from 0 to 204800000 [ 7902.338645] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7902.373758] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7902.446807] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7902.456177] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 7902.466521] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7902.472794] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7902.479378] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 7902.488830] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7902.497551] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 7902.504596] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 7902.509913] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 7902.517415] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 7902.524434] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 7902.534292] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 7902.542782] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 7902.551107] Lustre: 268078:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 7907.133491] Lustre: server umount MGS complete [ 7907.789905] loop0: detected capacity change from 0 to 204800000 [ 7907.847865] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7908.118559] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7908.158058] Lustre: lustre-MDT0000: Aborting client recovery [ 7908.849217] loop1: detected capacity change from 0 to 204800000 [ 7908.978255] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7909.034598] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7909.044540] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7909.051896] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 7909.057277] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7909.063408] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7909.073226] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 7909.083904] Lustre: 268510:0:(osd_scrub.c:1840:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 7909.099205] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7909.260209] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7909.310128] Lustre: lustre-MDT0001: Aborting client recovery [ 7909.979612] loop2: detected capacity change from 0 to 204800000 [ 7910.167666] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7910.192619] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7910.199574] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7910.206439] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7910.212924] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7910.220337] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7910.227851] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7910.234497] Lustre: 268591:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7910.316472] Lustre: Found index 0 for lustre-OST0000, updating log [ 7910.340466] Lustre: 268609:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7910.418580] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7910.434193] Lustre: lustre-OST0000: Aborting recovery [ 7911.117463] loop3: detected capacity change from 0 to 204800000 [ 7911.228949] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7911.330639] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7911.350504] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7911.361058] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7911.371442] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7911.378347] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7911.385199] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7911.392682] Lustre: 268675:0:(osd_scrub.c:1840:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7911.406675] Lustre: Found index 1 for lustre-OST0001, updating log [ 7911.426741] Lustre: 268680:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7911.480162] Lustre: lustre-OST0001: Aborting recovery [ 7916.575547] LustreError: 268453:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 7918.576431] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7918.605536] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7918.621775] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 7918.646853] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 7919.602921] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 7919.606037] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 7924.337510] LustreError: 268420:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 834us: rc = -2 [ 7924.838956] LustreError: 268417:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 418us: rc = -2 [ 7924.846440] LustreError: 268417:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 29 previous similar messages [ 7940.070208] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7940.071431] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7940.075344] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7940.083614] Lustre: Skipped 2 previous similar messages [ 7942.736547] Lustre: server umount lustre-MDT0000 complete [ 7943.432438] LustreError: 268403:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780343274 with bad export cookie 13235069476620296290 [ 7943.436340] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7943.439271] LustreError: 268403:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7945.185385] LustreError: 268417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7945.185923] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7945.205482] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7945.205506] Lustre: Skipped 3 previous similar messages [ 7945.216179] LustreError: 268417:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7945.246120] Lustre: Skipped 2 previous similar messages [ 7948.262705] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7948.263975] LustreError: 268912:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7948.265900] Lustre: Skipped 1 previous similar message [ 7948.287563] LustreError: 268912:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7949.889126] Lustre: server umount lustre-MDT0001 complete [ 7956.743991] Lustre: server umount lustre-OST0000 complete [ 7963.672882] Lustre: server umount lustre-OST0001 complete [ 7969.488226] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 15:48:19 (1780343299) [ 7989.149900] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 7995.210267] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 8023.690729] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8023.858432] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8023.876579] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8023.924192] Lustre: lustre-MDT0000: new disk, initializing [ 8023.973563] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8023.976825] Lustre: Skipped 1 previous similar message [ 8023.988478] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8027.415896] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8035.746218] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8035.813272] Lustre: 272710:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8035.852289] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8035.855456] Lustre: Skipped 1 previous similar message [ 8035.928501] Lustre: lustre-MDT0001: new disk, initializing [ 8036.004813] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8036.043120] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8036.067377] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8039.784939] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8045.950251] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8049.057609] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8054.429395] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8054.714332] Lustre: lustre-OST0000: new disk, initializing [ 8054.716707] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8054.721871] Lustre: 274451:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8054.789276] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8058.982487] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8061.466122] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8061.478364] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8061.556661] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8064.261422] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8068.640926] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8077.836201] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8084.322512] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8091.482950] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8138.209906] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8138.212799] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8138.214387] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8138.218072] Lustre: Skipped 1 previous similar message [ 8138.226049] Lustre: Skipped 2 previous similar messages [ 8142.786228] Lustre: server umount lustre-OST0000 complete [ 8148.449779] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8148.451568] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8148.462144] Lustre: Skipped 1 previous similar message [ 8151.418921] Lustre: server umount lustre-MDT0000 complete [ 8153.572335] LustreError: 272716:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8153.583119] LustreError: 272716:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8153.607663] LustreError: 275193:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780343484 with bad export cookie 13235069476620299048 [ 8153.609690] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8153.615166] LustreError: 275193:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 8153.854930] Lustre: server umount lustre-MDT0001 complete [ 8159.416419] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8162.656439] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8166.060491] Lustre: server umount MGS complete [ 8173.492916] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8173.771114] LustreError: 278239:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8173.790778] LustreError: 278252:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8173.832738] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8176.929990] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8179.171525] LustreError: 278240:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8182.645894] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8186.001218] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8189.909228] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8192.404254] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8197.155695] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8201.784065] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8205.217521] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8229.351581] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8229.364880] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8229.373728] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8229.376619] Lustre: Skipped 1 previous similar message [ 8232.905912] Lustre: server umount lustre-OST0000 complete [ 8239.586430] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8239.586441] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8239.600054] Lustre: Skipped 2 previous similar messages [ 8241.520403] Lustre: server umount lustre-MDT0000 complete [ 8243.939227] LustreError: 278221:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780343575 with bad export cookie 13235069476620301043 [ 8243.943216] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8243.950134] LustreError: 278221:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8244.160766] Lustre: server umount lustre-MDT0001 complete [ 8251.484233] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 8253.194212] Key type lgssc unregistered [ 8253.405224] LNet: 281822:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8253.419287] LNetError: 281822:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8253.434090] LNet: Removed LNI 192.168.202.123@tcp [ 8254.046072] Key type .llcrypt unregistered [ 8254.047875] Key type ._llcrypt unregistered [ 8278.810319] Key type ._llcrypt registered [ 8278.812226] Key type .llcrypt registered [ 8278.875310] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 8288.921357] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 8289.561901] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8289.627063] alg: No test for adler32 (adler32-zlib) [ 8290.566384] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 8290.696168] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 8292.321276] Key type lgssc registered [ 8293.427304] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8319.248625] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8319.262465] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8320.451325] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8320.491108] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8320.544245] Lustre: lustre-MDT0000: new disk, initializing [ 8320.598430] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8320.633491] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8324.343411] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8332.964430] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8333.029280] Lustre: 285719:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8333.076731] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8333.078596] Lustre: Skipped 1 previous similar message [ 8333.135445] Lustre: lustre-MDT0001: new disk, initializing [ 8333.208090] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8333.237554] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8333.246991] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8336.064466] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8342.049637] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8345.136473] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8349.938538] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8350.086731] Lustre: lustre-OST0000: new disk, initializing [ 8350.089860] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8350.094108] Lustre: 287463:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8350.156082] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8354.128180] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8356.920661] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8356.931684] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8357.050861] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8359.868152] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8364.720719] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8368.788853] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8373.258839] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8378.382173] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8423.911090] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8423.912134] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8423.933857] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8423.933867] Lustre: Skipped 1 previous similar message [ 8428.935669] Lustre: server umount lustre-OST0000 complete [ 8434.145698] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8434.147434] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8434.156547] Lustre: Skipped 2 previous similar messages [ 8434.161115] Lustre: Skipped 1 previous similar message [ 8437.891777] Lustre: server umount lustre-MDT0000 complete [ 8440.397266] LustreError: 288758:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780343771 with bad export cookie 11422475504645306138 [ 8440.398842] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8440.403808] LustreError: 288758:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8440.708773] Lustre: server umount lustre-MDT0001 complete [ 8447.451717] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8450.917496] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8454.582994] Lustre: server umount MGS complete [ 8463.419521] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8463.760667] LustreError: 291051:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8463.781520] LustreError: 291051:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8463.794839] LustreError: 291064:0:(qmt_pool.c:1630:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8463.845165] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8466.638534] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8468.963929] LustreError: 291052:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8472.412290] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8472.617522] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8475.632768] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8479.194429] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8481.763385] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8485.934544] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8486.120818] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8490.360488] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8494.172933] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8518.118380] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8518.119067] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8518.123061] LustreError: Skipped 1 previous similar message [ 8518.132863] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8518.137756] Lustre: Skipped 1 previous similar message [ 8522.820444] Lustre: server umount lustre-OST0000 complete [ 8528.355907] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8528.366687] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8528.366945] Lustre: Skipped 2 previous similar messages [ 8528.374457] Lustre: Skipped 1 previous similar message [ 8531.223593] Lustre: server umount lustre-MDT0000 complete [ 8533.473122] LustreError: 291051:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8533.478035] LustreError: 291051:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8533.687940] LustreError: 291033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780343864 with bad export cookie 11422475504645308021 [ 8533.695865] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8533.699547] LustreError: 291033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8533.922791] Lustre: server umount lustre-MDT0001 complete [ 8539.858417] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 8541.408740] Key type lgssc unregistered [ 8541.597794] LNet: 294636:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8541.603401] LNetError: 294636:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8541.612959] LNet: Removed LNI 192.168.202.123@tcp [ 8542.192695] Key type .llcrypt unregistered [ 8542.195163] Key type ._llcrypt unregistered [ 8554.888416] Key type ._llcrypt registered [ 8554.890176] Key type .llcrypt registered [ 8554.950954] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 8564.617272] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 8565.013640] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8565.055474] alg: No test for adler32 (adler32-zlib) [ 8566.077640] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 8566.286528] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 8567.952140] Key type lgssc registered [ 8568.715846] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8585.720583] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 8596.795702] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8596.823976] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8598.108373] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8598.141463] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8598.216532] Lustre: lustre-MDT0000: new disk, initializing [ 8598.291207] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8598.303257] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8601.119111] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8607.013947] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8607.142227] Lustre: lustre-OST0000: new disk, initializing [ 8607.145107] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8607.148932] Lustre: Skipped 1 previous similar message [ 8607.151959] Lustre: 298594:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8607.189637] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8609.854329] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 8612.360418] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8612.366180] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8612.380857] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 8980.961344] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8980.966630] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8981.777654] Lustre: server umount lustre-MDT0000 complete [ 8983.514505] LustreError: 297797:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344314 with bad export cookie 7334951418190808889 [ 8983.517648] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8983.518678] LustreError: 297797:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8985.657411] Lustre: server umount lustre-OST0000 complete [ 8995.901179] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 9000.016191] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9015.831080] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9015.936402] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9015.955215] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9016.019156] Lustre: lustre-MDT0000: new disk, initializing [ 9016.054658] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9016.061945] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9017.521105] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9022.075938] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9022.123561] Lustre: 302809:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9022.149675] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9022.152097] Lustre: Skipped 1 previous similar message [ 9022.189740] Lustre: lustre-MDT0001: new disk, initializing [ 9022.226303] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9022.240486] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9022.244815] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9023.724473] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9027.156749] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9028.630393] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9031.277089] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9031.387652] Lustre: lustre-OST0000: new disk, initializing [ 9031.389752] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9031.392970] Lustre: 304551:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9031.422904] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9033.412745] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9036.812511] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9036.815121] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9036.817037] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9036.863397] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9038.383035] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9038.466840] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9039.919438] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9040.007142] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9041.889740] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9041.891899] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9041.892483] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9041.893113] LustreError: Skipped 1 previous similar message [ 9041.897172] Lustre: Skipped 1 previous similar message [ 9046.742286] Lustre: server umount lustre-OST0000 complete [ 9052.129348] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9052.130152] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9052.133483] Lustre: Skipped 1 previous similar message [ 9052.135684] Lustre: Skipped 1 previous similar message [ 9054.375912] Lustre: server umount lustre-MDT0000 complete [ 9055.798252] LustreError: 304550:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344387 with bad export cookie 7334951418193749694 [ 9055.804713] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9055.932603] Lustre: server umount lustre-MDT0001 complete [ 9057.278580] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 9057.961252] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 16:06:28 (1780344388) [ 9060.495790] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9060.708065] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9062.101926] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9065.446368] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9067.241885] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9069.628754] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9071.191545] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9073.866326] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9076.331792] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9078.367474] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9081.186922] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9081.257472] Lustre: lustre-OST0001: new disk, initializing [ 9081.259801] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 9081.262691] Lustre: 309207:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9081.302234] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9081.305648] Lustre: Skipped 2 previous similar messages [ 9082.066526] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 9082.070702] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 9082.086273] LustreError: 309324:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9083.111580] LustreError: 309332:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9083.115557] LustreError: 309332:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9083.549786] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9084.132276] LustreError: 309324:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9084.136303] LustreError: 309324:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 9086.180390] LustreError: 309324:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9086.183849] LustreError: 309324:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 9087.723301] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9087.818891] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9089.204806] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff936a19162800.ost_server_uuid 50 [ 9089.774881] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff936a19162800.ost_server_uuid in FULL state after 0 sec [ 9090.276241] LustreError: 309332:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9090.280695] LustreError: 309332:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 9091.070244] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff936a19162800.ost_server_uuid 50 [ 9091.602243] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff936a19162800.ost_server_uuid in FULL state after 0 sec [ 9092.327323] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 9105.891536] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9105.897195] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9105.899559] Lustre: Skipped 2 previous similar messages [ 9109.437849] Lustre: server umount lustre-OST0001 complete [ 9111.012098] LustreError: 308305:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9111.017496] LustreError: 308305:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9116.131263] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9116.131569] LustreError: 309629:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9116.132791] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9116.132800] Lustre: Skipped 1 previous similar message [ 9116.133449] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9116.133454] Lustre: Skipped 1 previous similar message [ 9116.135793] LustreError: Skipped 1 previous similar message [ 9116.141217] LustreError: 309629:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9117.205890] Lustre: server umount lustre-OST0000 complete [ 9124.835663] Lustre: server umount lustre-MDT0000 complete [ 9126.229428] LustreError: 308328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344457 with bad export cookie 7334951418193750618 [ 9126.230311] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9126.233659] LustreError: 308328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 9126.361835] Lustre: server umount lustre-MDT0001 complete [ 9130.239274] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 9131.347453] Key type lgssc unregistered [ 9131.482580] LNet: 311646:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9131.486382] LNetError: 311646:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9131.495451] LNet: Removed LNI 192.168.202.123@tcp [ 9131.828183] Key type .llcrypt unregistered [ 9131.829829] Key type ._llcrypt unregistered [ 9142.450661] Key type ._llcrypt registered [ 9142.452078] Key type .llcrypt registered [ 9142.488799] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9142.881808] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9142.921572] alg: No test for adler32 (adler32-zlib) [ 9143.788956] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 9143.882514] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 9145.480139] Key type lgssc registered [ 9145.916713] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9148.974594] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9148.983113] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9150.179592] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9151.656499] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9153.624922] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9156.455187] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9156.615716] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9158.204618] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9162.106656] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9162.240891] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9164.275766] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9166.299794] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9166.377583] LustreError: 315130:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9166.385214] LustreError: 315130:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9169.016872] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9169.115408] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9171.370598] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9173.502311] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 9175.535085] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 9175.539905] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 9180.578989] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 9180.692185] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9260.516076] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9260.520824] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9260.523973] Lustre: Skipped 1 previous similar message [ 9265.465370] Lustre: server umount lustre-OST0001 complete [ 9265.635901] LustreError: 314576:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9265.645251] LustreError: 314576:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9267.680913] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9267.684283] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9267.691154] Lustre: Skipped 1 previous similar message [ 9267.693255] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9268.704815] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9268.707481] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9268.711429] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9270.754980] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9270.755751] LustreError: 314577:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9270.757409] Lustre: Skipped 1 previous similar message [ 9270.762845] LustreError: 314577:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9273.371427] Lustre: server umount lustre-OST0000 complete [ 9275.874569] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9275.875734] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9275.879183] Lustre: Skipped 1 previous similar message [ 9281.196043] Lustre: server umount lustre-MDT0000 complete [ 9282.712094] LustreError: 313007:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344614 with bad export cookie 17575619866945819145 [ 9282.714854] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9282.720068] LustreError: 313007:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9282.864666] Lustre: server umount lustre-MDT0001 complete [ 9286.963859] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 9288.173528] Key type lgssc unregistered [ 9288.333788] LNet: 317576:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9288.337332] LNetError: 317576:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9288.346763] LNet: Removed LNI 192.168.202.123@tcp [ 9288.730224] Key type .llcrypt unregistered [ 9288.731942] Key type ._llcrypt unregistered [ 9311.928746] Key type ._llcrypt registered [ 9311.930178] Key type .llcrypt registered [ 9311.988448] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9312.417575] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9312.460563] alg: No test for adler32 (adler32-zlib) [ 9313.365067] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 9313.490573] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 9315.097820] Key type lgssc registered [ 9315.580058] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9319.976328] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9319.985275] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9321.217061] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9323.166185] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9327.076196] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9327.273971] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9328.922943] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9330.177427] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 9332.597625] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9332.727989] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9334.776425] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9336.804852] LustreError: 321279:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9336.813953] LustreError: 321279:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9338.064758] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9338.159977] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9340.357134] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9346.537540] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 9346.537833] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 9349.799577] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 9355.514371] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 9361.110428] Lustre: server umount lustre-MDT0000 complete [ 9361.890966] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9361.891876] LustreError: 319819:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9361.895976] Lustre: Skipped 2 previous similar messages [ 9361.902509] LustreError: 319819:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9362.328130] LustreError: 322822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344693 with bad export cookie 14769892021555135114 [ 9362.330787] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9362.332300] LustreError: 322822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9364.480496] Lustre: server umount lustre-MDT0001 complete [ 9376.260412] Lustre: server umount lustre-OST0000 complete [ 9386.912393] Lustre: server umount lustre-OST0001 complete [ 9392.333326] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9395.872510] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9396.015791] LustreError: 324997:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9396.040367] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9397.379896] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9400.326689] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9401.907091] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9402.988362] Lustre: 326105:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 9405.324171] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9405.486332] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9405.488956] Lustre: Skipped 1 previous similar message [ 9406.500335] LustreError: 326456:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9406.508406] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 9407.483952] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9410.579440] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9410.596392] LustreError: 326459:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9410.604381] LustreError: 326459:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9412.649460] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9415.907116] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 9416.170806] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 9417.203476] Lustre: 327942:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 9421.283259] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9421.283471] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9421.285158] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9421.292658] Lustre: Skipped 3 previous similar messages [ 9424.291821] Lustre: server umount lustre-MDT0000 complete [ 9425.585199] LustreError: 324979:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344756 with bad export cookie 14769892021555136787 [ 9425.588678] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9425.589882] LustreError: 324979:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9425.704145] Lustre: server umount lustre-MDT0001 complete [ 9437.398484] Lustre: server umount lustre-OST0000 complete [ 9449.325053] Lustre: server umount lustre-OST0001 complete [ 9450.929223] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 9451.558555] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 9452.275279] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 16:13:03 (1780344783) [ 9461.549532] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9465.117909] loop0: detected capacity change from 0 to 1099511627776 [ 9465.312527] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 9465.316663] *** VALIDATE xfs *** [ 9465.323031] XFS (loop0): Mounting V5 Filesystem [ 9465.333555] XFS (loop0): Ending clean mount [ 9465.878168] loop1: detected capacity change from 0 to 18691697672192 [ 9493.005914] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 9497.044429] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9514.698154] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9514.827731] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9514.841688] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9514.889123] Lustre: lustre-MDT0000: new disk, initializing [ 9514.947418] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9514.951025] Lustre: Skipped 1 previous similar message [ 9514.961464] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9516.827697] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9522.865490] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9522.928628] Lustre: 333004:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9522.964867] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9522.969260] Lustre: Skipped 1 previous similar message [ 9523.025895] Lustre: lustre-MDT0001: new disk, initializing [ 9523.109969] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9523.118712] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9525.176520] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9529.221767] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9531.072382] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9534.476421] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9534.601608] Lustre: lustre-OST0000: new disk, initializing [ 9534.603830] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9534.607799] Lustre: 334746:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9535.892509] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9535.900019] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9535.941505] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9537.583105] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9541.797953] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9544.163589] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9544.290226] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9546.664923] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9546.808481] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9551.336942] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9551.339672] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9551.340546] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9551.340551] Lustre: Skipped 3 previous similar messages [ 9551.342515] LustreError: Skipped 1 previous similar message [ 9551.363434] Lustre: Skipped 2 previous similar messages [ 9554.046697] Lustre: server umount lustre-OST0000 complete [ 9556.449888] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9556.451442] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9556.457063] Lustre: Skipped 1 previous similar message [ 9556.463759] Lustre: Skipped 1 previous similar message [ 9561.569211] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9561.572070] Lustre: Skipped 2 previous similar messages [ 9561.769939] Lustre: server umount lustre-MDT0000 complete [ 9563.269471] LustreError: 334745:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344894 with bad export cookie 14769892021555138320 [ 9563.272458] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9563.275367] LustreError: 334745:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9563.394854] Lustre: server umount lustre-MDT0001 complete [ 9566.670858] XFS (loop0): Unmounting Filesystem [ 9568.729582] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 16:14:59 (1780344899) [ 9571.326144] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9571.514882] LustreError: 337156:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9571.547242] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9571.550768] Lustre: Skipped 2 previous similar messages [ 9573.156428] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9576.641236] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9578.243975] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9580.280518] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9581.688369] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9584.513148] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9586.981305] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9589.140746] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9606.115777] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9606.116238] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9606.117020] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9606.124770] Lustre: Skipped 1 previous similar message [ 9609.567336] Lustre: server umount lustre-OST0000 complete [ 9616.353372] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9616.357291] Lustre: Skipped 4 previous similar messages [ 9617.342335] Lustre: server umount lustre-MDT0000 complete [ 9619.066560] LustreError: 337875:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780344950 with bad export cookie 14769892021555139244 [ 9619.069132] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9619.075239] LustreError: 337875:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9619.235804] Lustre: server umount lustre-MDT0001 complete [ 9623.420587] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 9624.738316] Key type lgssc unregistered [ 9624.925752] LNet: 340447:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9624.930308] LNetError: 340447:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9624.947695] LNet: Removed LNI 192.168.202.123@tcp [ 9625.418738] Key type .llcrypt unregistered [ 9625.420500] Key type ._llcrypt unregistered [ 9638.303559] Key type ._llcrypt registered [ 9638.306202] Key type .llcrypt registered [ 9638.349858] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 9638.812537] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9638.820324] alg: No test for adler32 (adler32-zlib) [ 9639.709918] Lustre: Lustre: Build Version: 2.17.53_34_g0f61aab [ 9639.820204] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 9641.416154] Key type lgssc registered [ 9641.895160] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9645.291065] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9645.299324] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9646.489718] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9648.020926] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9651.332675] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9651.449554] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9652.726564] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9654.526286] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9655.791440] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9658.083073] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9658.211688] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9660.424140] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9662.449927] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9676.770521] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9676.778194] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9676.782188] Lustre: Skipped 1 previous similar message [ 9678.170221] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.23@tcp (stopping) [ 9681.889982] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9681.893044] Lustre: Skipped 1 previous similar message [ 9682.253703] Lustre: server umount lustre-MDT0001 complete [ 9683.282759] LustreError: 343590:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9683.289061] LustreError: 343590:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9686.969854] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9687.014520] LustreError: 341976:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9687.022404] LustreError: 341976:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9687.076213] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 9687.085793] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9687.117961] Lustre: 341964:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9687.316572] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9689.171906] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [ 9692.652432] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 9696.230720] LustreError: 345401:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 9696.234112] LustreError: 345401:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 9696.238164] LustreError: 341968:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 9696.261633] LustreError: 345404:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.123@tcp: cfg command failed: rc = -17 [ 9696.268757] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 9696.268757] [ 9992.676667] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9992.682701] Lustre: Skipped 1 previous similar message [ 9992.685244] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9992.687439] Lustre: Skipped 1 previous similar message [ 9997.796507] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9997.800513] Lustre: Skipped 2 previous similar messages [ 9997.888736] Lustre: server umount lustre-MDT0001 complete [10000.723896] LustreError: 343590:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10002.708402] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10002.768641] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10002.770576] Lustre: Found index 1 for lustre-MDT0001, updating log [10002.792339] Lustre: 341965:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10002.944317] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10004.647300] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [10008.040444] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10009.577739] LustreError: 357208:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10009.581603] LustreError: 357208:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10009.585286] LustreError: 341968:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10009.590950] LustreError: 341968:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10009.616512] LustreError: 357211:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [10009.619898] LustreError: 357211:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [10009.625768] LustreError: 357211:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.123@tcp: cfg command failed: rc = -17 [10009.633370] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.123@tcp [10009.633370] [10307.928637] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.23@tcp (stopping) [10310.122963] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10310.135294] Lustre: Skipped 1 previous similar message [10310.139196] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10322.400125] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10322.537237] Lustre: server umount lustre-MDT0001 complete [10323.282679] LustreError: 343590:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10328.401084] LustreError: 344127:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10328.410186] LustreError: 344127:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10328.584299] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10328.629492] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10328.631700] Lustre: Found index 1 for lustre-MDT0001, updating log [10328.649866] Lustre: 341964:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10328.773063] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [10330.428899] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [10334.187128] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10335.212534] LustreError: 369349:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10335.216970] LustreError: 369349:0:(tgt_mount.c:668:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10335.221065] LustreError: 341968:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10335.223771] LustreError: 341968:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10335.250884] LustreError: 369356:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [10335.258900] LustreError: 369356:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.123@tcp: cfg command failed: rc = -114 [10335.263101] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [10335.263101] [10649.571363] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10649.578280] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10649.581962] Lustre: Skipped 2 previous similar messages [10649.592697] Lustre: Skipped 10 previous similar messages [10662.368556] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10662.501277] Lustre: server umount lustre-MDT0000 complete [10664.930239] LustreError: 343590:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10664.947057] LustreError: 343590:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10665.248374] LustreError: 341958:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780345996 with bad export cookie 5421809337352199411 [10665.255139] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10665.260596] LustreError: 341958:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10670.050587] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10670.062861] Lustre: Skipped 1 previous similar message [10671.611519] Lustre: server umount lustre-MDT0001 complete [10674.081994] Lustre: server umount lustre-OST0000 complete [10680.027384] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [10685.927632] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [10708.879471] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 16:33:59 (1780346039) [10712.469773] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10712.599835] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10712.616476] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10712.666752] Lustre: lustre-MDT0000: new disk, initializing [10712.730068] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10712.745988] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10715.083948] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [10720.849395] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10720.902240] Lustre: 380846:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10720.935263] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [10720.938073] Lustre: Skipped 7 previous similar messages [10720.939339] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10720.943076] Lustre: Skipped 1 previous similar message [10720.983374] Lustre: lustre-MDT0001: new disk, initializing [10721.034677] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10721.057699] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10721.064635] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10722.983197] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [10727.344190] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10729.267227] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10732.179984] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10732.307228] Lustre: lustre-OST0000: new disk, initializing [10732.310072] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10732.313264] Lustre: 382591:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10732.358170] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10733.824588] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10733.828720] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10733.869898] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10734.853762] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug -1 all [10738.839120] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10744.290185] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10744.297447] Lustre: Skipped 2 previous similar messages [10748.443767] Lustre: server umount lustre-MDT0000 complete [10749.409640] LustreError: 382486:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10749.415067] LustreError: 382486:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [10750.265150] LustreError: 380840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1780346081 with bad export cookie 5421809337352201350 [10750.268337] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10750.272385] LustreError: 380840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10750.430849] Lustre: server umount lustre-MDT0001 complete [10762.746217] Lustre: server umount lustre-OST0000 complete [10777.273737] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [10782.487968] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [10798.719951] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 10518 sec ========= 16:35:29 (1780346129) [10799.619787] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 16:35:30 (1780346130) === [10801.455470] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 16:35:31 (1780346131) === [10823.497168] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [10825.054925] Key type lgssc unregistered [10825.221036] LNet: 388781:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10825.224432] LNetError: 388781:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [10825.233367] LNet: Removed LNI 192.168.202.123@tcp [10825.623469] Key type .llcrypt unregistered [10825.624622] Key type ._llcrypt unregistered