[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 465448051 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.003134] x2apic enabled [ 0.004007] Switched APIC routing to physical x2apic. [ 0.005010] kvm-guest: setup PV IPIs [ 0.007958] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008020] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009031] pid_max: default: 32768 minimum: 301 [ 0.010101] LSM: Security Framework initializing [ 0.011046] Yama: becoming mindful. [ 0.012034] SELinux: Initializing. [ 0.013053] *** VALIDATE selinux *** [ 0.020803] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025408] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026123] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027113] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029109] *** VALIDATE tmpfs *** [ 0.031260] *** VALIDATE proc *** [ 0.033110] *** VALIDATE cgroup *** [ 0.034013] *** VALIDATE cgroup2 *** [ 0.036110] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.038146] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.039010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.040031] Spectre V2 : User space: Vulnerable [ 0.041011] Speculative Store Bypass: Vulnerable [ 0.044632] debug: unmapping init [mem 0xffffffffa5259000-0xffffffffa5260fff] [ 0.047000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.047731] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.048025] ... version: 2 [ 0.049009] ... bit width: 48 [ 0.050012] ... generic registers: 4 [ 0.051013] ... value mask: 0000ffffffffffff [ 0.052015] ... max period: 00007fffffffffff [ 0.053015] ... fixed-purpose events: 3 [ 0.054012] ... event mask: 000000070000000f [ 0.055309] rcu: Hierarchical SRCU implementation. [ 0.057398] smp: Bringing up secondary CPUs ... [ 0.058610] x86: Booting SMP configuration: [ 0.059025] .... node #0, CPUs: #1 #2 #3 [ 0.062352] smp: Brought up 1 node, 4 CPUs [ 0.064016] smpboot: Max logical packages: 1 [ 0.065019] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.126023] node 0 deferred pages initialised in 57ms [ 0.128423] devtmpfs: initialized [ 0.129150] x86/mm: Memory block size: 128MB [ 0.133239] gcov: version magic: 0x41383552 [ 0.136184] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.139100] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.141273] pinctrl core: initialized pinctrl subsystem [ 0.143180] [ 0.144008] ************************************************************* [ 0.147014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.150014] ** ** [ 0.152012] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.155016] ** ** [ 0.158026] ** This means that this kernel is built to expose internal ** [ 0.161012] ** IOMMU data structures, which may compromise security on ** [ 0.164021] ** your system. ** [ 0.166010] ** ** [ 0.168009] ** If you see this message and you are not debugging the ** [ 0.171011] ** kernel, report this immediately to your vendor! ** [ 0.174013] ** ** [ 0.176012] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.179012] ************************************************************* [ 0.182353] NET: Registered protocol family 16 [ 0.184414] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.186056] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.189055] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.192032] cpuidle: using governor menu [ 0.193538] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.195352] PCI: Using configuration type 1 for base access [ 0.197135] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.205047] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.206022] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.208063] cryptd: max_cpu_qlen set to 1000 [ 0.211242] ACPI: Added _OSI(Module Device) [ 0.213019] ACPI: Added _OSI(Processor Device) [ 0.215011] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.216013] ACPI: Added _OSI(Processor Aggregator Device) [ 0.221028] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.227612] ACPI: Interpreter enabled [ 0.229067] ACPI: PM: (supports S0 S3 S4 S5) [ 0.231028] ACPI: Using IOAPIC for interrupt routing [ 0.233136] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.238448] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.250155] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.253081] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.257023] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.261080] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.266307] acpiphp: Slot [2] registered [ 0.268127] acpiphp: Slot [5] registered [ 0.270118] acpiphp: Slot [6] registered [ 0.271076] acpiphp: Slot [7] registered [ 0.273125] acpiphp: Slot [8] registered [ 0.274102] acpiphp: Slot [9] registered [ 0.276121] acpiphp: Slot [10] registered [ 0.277098] acpiphp: Slot [3] registered [ 0.279133] acpiphp: Slot [4] registered [ 0.280081] acpiphp: Slot [11] registered [ 0.281086] acpiphp: Slot [12] registered [ 0.283094] acpiphp: Slot [13] registered [ 0.284083] acpiphp: Slot [14] registered [ 0.286092] acpiphp: Slot [15] registered [ 0.287080] acpiphp: Slot [16] registered [ 0.289161] acpiphp: Slot [17] registered [ 0.290098] acpiphp: Slot [18] registered [ 0.292085] acpiphp: Slot [19] registered [ 0.294092] acpiphp: Slot [20] registered [ 0.295088] acpiphp: Slot [21] registered [ 0.297095] acpiphp: Slot [22] registered [ 0.298104] acpiphp: Slot [23] registered [ 0.300059] acpiphp: Slot [24] registered [ 0.301101] acpiphp: Slot [25] registered [ 0.303125] acpiphp: Slot [26] registered [ 0.305113] acpiphp: Slot [27] registered [ 0.307107] acpiphp: Slot [28] registered [ 0.309130] acpiphp: Slot [29] registered [ 0.310125] acpiphp: Slot [30] registered [ 0.312097] acpiphp: Slot [31] registered [ 0.314064] PCI host bridge to bus 0000:00 [ 0.316022] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.319023] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.322027] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.325031] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.327019] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.331025] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.333217] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.335868] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.339260] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.348012] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.353514] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.356020] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.358016] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.360016] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.363535] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.366867] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.369038] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.372796] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.379026] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.395024] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.401848] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.408875] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.418016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.426015] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.443017] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.455399] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.466021] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.473024] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.493024] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.504888] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.512022] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.520026] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.539020] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.550252] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.557021] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.566017] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.590024] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.602061] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.609025] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.618023] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.639022] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.651202] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.658020] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.667022] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.685023] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.698949] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.701310] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.703455] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.706357] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.708224] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.713171] iommu: Default domain type: Passthrough [ 0.715530] SCSI subsystem initialized [ 0.717173] ACPI: bus type USB registered [ 0.719164] usbcore: registered new interface driver usbfs [ 0.721114] usbcore: registered new interface driver hub [ 0.724122] usbcore: registered new device driver usb [ 0.726175] pps_core: LinuxPPS API ver. 1 registered [ 0.728021] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.732088] PTP clock support registered [ 0.735054] EDAC MC: Ver: 3.0.0 [ 0.737162] PCI: Using ACPI for IRQ routing [ 0.739159] NetLabel: Initializing [ 0.741014] NetLabel: domain hash size = 128 [ 0.742009] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.744105] NetLabel: unlabeled traffic allowed by default [ 0.747104] vgaarb: loaded [ 0.748341] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.750019] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.757552] clocksource: Switched to clocksource kvm-clock [ 0.862624] VFS: Disk quotas dquot_6.6.0 [ 0.863965] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.866428] *** VALIDATE ramfs *** [ 0.867683] *** VALIDATE hugetlbfs *** [ 0.869064] pnp: PnP ACPI init [ 0.872112] pnp: PnP ACPI: found 6 devices [ 0.898579] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.901974] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.904112] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.906437] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.909353] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.911902] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.914645] NET: Registered protocol family 2 [ 0.917332] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.922056] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.924759] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.930337] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.934124] TCP: Hash tables configured (established 65536 bind 65536) [ 0.937411] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.940853] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.944325] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.947952] NET: Registered protocol family 1 [ 0.950746] RPC: Registered named UNIX socket transport module. [ 0.953348] RPC: Registered udp transport module. [ 0.954965] RPC: Registered tcp transport module. [ 0.956424] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.958256] NET: Registered protocol family 44 [ 0.960279] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.962975] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.965537] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.968184] PCI: CLS 0 bytes, default 64 [ 0.970516] Unpacking initramfs... [ 2.372474] debug: unmapping init [mem 0xffff9349fcc54000-0xffff9349fffbffff] [ 2.376827] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.379733] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.383307] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.889155] Initialise system trusted keyrings [ 2.890809] Key type blacklist registered [ 2.892666] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.903044] zbud: loaded [ 2.906278] *** VALIDATE nfs *** [ 2.907691] *** VALIDATE nfs4 *** [ 2.909522] pstore: using deflate compression [ 2.914360] Platform Keyring initialized [ 3.026989] NET: Registered protocol family 38 [ 3.028745] Key type asymmetric registered [ 3.030306] Asymmetric key parser 'x509' registered [ 3.032217] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.035610] io scheduler mq-deadline registered [ 3.037119] io scheduler kyber registered [ 3.038311] io scheduler bfq registered [ 3.040587] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.043666] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.046341] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.049107] ACPI: Power Button [PWRF] [ 3.053452] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.060153] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.071175] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.077217] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.088573] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.115779] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.144230] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.154848] Non-volatile memory driver v1.3 [ 3.156482] Linux agpgart interface v0.103 [ 3.190716] virtio_blk virtio1: [vda] 145160 512-byte logical blocks (74.3 MB/70.9 MiB) [ 3.194157] vda: detected capacity change from 0 to 74321920 [ 3.206958] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.210928] vdb: detected capacity change from 0 to 1073741824 [ 3.225974] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.229500] vdc: detected capacity change from 0 to 2621440000 [ 3.243527] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.245972] vdd: detected capacity change from 0 to 2621440000 [ 3.259234] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.262112] vde: detected capacity change from 0 to 4294967296 [ 3.277746] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.280889] vdf: detected capacity change from 0 to 4294967296 [ 3.287986] libphy: Fixed MDIO Bus: probed [ 3.297894] usbcore: registered new interface driver usbserial_generic [ 3.300212] usbserial: USB Serial support registered for generic [ 3.302384] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.307148] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.309180] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.311678] mousedev: PS/2 mouse device common for all mice [ 3.314761] rtc_cmos 00:05: RTC can wake from S4 [ 3.317132] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.319417] rtc_cmos 00:05: registered as rtc0 [ 3.322111] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.325093] intel_pstate: CPU model not supported [ 3.328364] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.331946] hid: raw HID events driver (C) Jiri Kosina [ 3.334045] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.335196] usbcore: registered new interface driver usbhid [ 3.341601] usbhid: USB HID core driver [ 3.343194] drop_monitor: Initializing network drop monitor service [ 3.346094] Initializing XFRM netlink socket [ 3.348214] NET: Registered protocol family 10 [ 3.350507] Segment Routing with IPv6 [ 3.351945] NET: Registered protocol family 17 [ 3.353843] mpls_gso: MPLS GSO support [ 3.359813] RAS: Correctable Errors collector initialized. [ 3.362108] AVX version of gcm_enc/dec engaged. [ 3.363275] AES CTR mode by8 optimization enabled [ 3.435525] sched_clock: Marking stable (3435508261, 0)->(4377752446, -942244185) [ 3.439259] registered taskstats version 1 [ 3.441350] Loading compiled-in X.509 certificates [ 3.443322] zswap: loaded using pool lzo/zbud [ 3.464966] Key type big_key registered [ 3.476718] Key type encrypted registered [ 3.478666] ima: No TPM chip found, activating TPM-bypass! [ 3.481652] ima: Allocated hash algorithm: sha1 [ 3.483360] ima: No architecture policies found [ 3.485274] evm: Initialising EVM extended attributes: [ 3.487442] evm: security.selinux [ 3.489456] evm: security.ima [ 3.490991] evm: security.capability [ 3.493103] evm: HMAC attrs: 0x1 [ 3.496616] rtc_cmos 00:05: setting system clock to 2026-06-23 12:24:50 UTC (1782217490) [ 3.504711] debug: unmapping init [mem 0xffffffffa6203000-0xffffffffa63fffff] [ 3.507521] debug: unmapping init [mem 0xffffffffa4f82000-0xffffffffa5258fff] [ 3.516063] Write protecting the kernel read-only data: 28672k [ 3.519786] debug: unmapping init [mem 0xffffffffa3603000-0xffffffffa37fffff] [ 3.522632] debug: unmapping init [mem 0xffffffffa3f14000-0xffffffffa3ffffff] [ 3.556510] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.567722] systemd[1]: Detected virtualization kvm. [ 3.569549] systemd[1]: Detected architecture x86-64. [ 3.571568] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.600607] systemd[1]: No hostname configured. [ 3.602630] systemd[1]: Set hostname to . [ 3.606036] random: systemd: uninitialized urandom read (16 bytes read) [ 3.608819] systemd[1]: Initializing machine ID from random generator. [ 3.667188] random: ln: uninitialized urandom read (6 bytes read) [ 3.756955] random: systemd: uninitialized urandom read (16 bytes read) [ 3.760465] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 3.770197] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 3.779763] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Swap. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Initrd Root Device. Starting Apply Kernel Variables... [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Paths. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Timers. [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.424264] device-mapper: uevent: version 1.0.3 [ 4.426619] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.176083] virtio_net virtio0 ens2: renamed from eth0 [ 5.240036] scsi host0: ata_piix [ 5.255967] random: fast init done [ 5.257212] scsi host1: ata_piix [ 5.260756] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.264181] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.800047] dracut-initqueue[588]: RTNETLINK answers: File exists [ 9.999338] random: crng init done [ 10.000952] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.503968] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.625882] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.861044] SELinux: Disabled at runtime. [ 11.918722] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.929454] systemd[1]: Detected virtualization kvm. [ 11.930613] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.437708] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.440650] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.446038] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.451356] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.455573] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.463685] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.469374] systemd[1]: proc-sys-fs-binfmt_misc.automount: Refusing to start, unit to trigger not loaded. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Mounting POSIX Message Queue File System... Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Listening on udev Control Socket. Mounting Huge Pages File System... Mounting Kernel Debug File System... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on initctl Compatibility Named Pipe. Starting Apply Kernel Variables... [ OK ] Created slice system-getty.slice. [ OK ] Listening on Process Core Dump Socket. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Listening on udev Kernel Socket. Activating swap /dev/disk/by-label/SWAP... Starting udev Coldplug all Devices... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ 12.609739] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Stopped target Initrd File Systems. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Configure read-only root support... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 12.916323] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 13.148110] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.203718] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.279922] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.303510] EDAC sbridge: Ver: 1.1.2 [ 15.024523] Key type dns_resolver registered [ 15.317323] NFS: Registering the id_resolver key type [ 15.318658] Key type id_resolver registered [ 15.319536] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. Starting Login Service... [ OK ] Started irqbalance daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. Starting Network Manager... Starting Restore /run/initramfs on shutdown... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg358-server login: [ 42.164629] libcfs: loading out-of-tree module taints kernel. [ 42.185407] Key type ._llcrypt registered [ 42.186848] Key type .llcrypt registered [ 42.234256] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 51.224449] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 51.963109] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 51.975101] alg: No test for adler32 (adler32-zlib) [ 53.023736] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 53.400966] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 55.040242] Key type lgssc registered [ 55.833586] Lustre: Echo OBD driver; http://www.lustre.org/ [ 70.764220] hrtimer: interrupt took 7199985 ns [ 71.543897] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 115.106895] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 127.361434] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 127.404245] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 128.615996] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 128.679479] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 128.767930] Lustre: lustre-MDT0000: new disk, initializing [ 128.863321] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 128.885432] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 133.079026] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 144.791927] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 144.905251] Lustre: 6476:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 144.950249] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 144.953865] Lustre: Skipped 1 previous similar message [ 145.077955] Lustre: lustre-MDT0001: new disk, initializing [ 145.165635] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 145.214391] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 145.222328] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 149.959210] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 155.299595] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 165.438642] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 165.862213] Lustre: lustre-OST0000: new disk, initializing [ 165.867959] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 165.877815] Lustre: 8415:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 165.940596] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 167.030723] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 167.043311] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 167.191534] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 172.441253] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 185.981743] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 186.124685] Lustre: lustre-OST0001: new disk, initializing [ 186.129436] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 186.136657] Lustre: 9486:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 186.204649] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 192.428722] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 194.595346] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 194.603981] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 194.663127] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 204.893996] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 213.647837] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 220.011408] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing check_logdir /tmp/testlogs/ [ 226.464546] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing yml_node [ 230.786463] Lustre: DEBUG MARKER: Client: 2.17.54.83 [ 232.855607] Lustre: DEBUG MARKER: MDS: 2.17.54.83 [ 235.458291] Lustre: DEBUG MARKER: OSS: 2.17.54.83 [ 237.197709] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Jun 23 08:28:43 EDT 2026 [ 254.889319] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 256.772807] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 273.376805] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 273.382475] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 273.400225] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 276.448855] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 276.449443] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 276.455301] Lustre: Skipped 2 previous similar messages [ 276.492315] Lustre: Skipped 2 previous similar messages [ 278.517480] Lustre: server umount lustre-MDT0000 complete [ 282.107153] LustreError: 10303:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217769 with bad export cookie 18340997192785888205 [ 282.113206] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 282.118686] LustreError: 10303:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 286.689180] LustreError: 6514:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 286.690652] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 286.702919] LustreError: 6514:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 286.727197] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 286.731104] Lustre: Skipped 2 previous similar messages [ 287.713299] LustreError: 6514:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 287.738610] LustreError: 6514:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 288.451043] Lustre: server umount lustre-MDT0001 complete [ 292.416282] Lustre: server umount lustre-OST0000 complete [ 296.296970] Lustre: server umount lustre-OST0001 complete [ 303.108831] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 312.481974] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 349.639438] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 349.944205] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 349.970187] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 350.084277] Lustre: lustre-MDT0000: new disk, initializing [ 350.201313] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 350.241909] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 355.466289] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 366.650381] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 366.848736] Lustre: 15043:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 366.957699] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 366.962320] Lustre: Skipped 1 previous similar message [ 367.080388] Lustre: lustre-MDT0001: new disk, initializing [ 367.188031] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 367.220109] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 367.234989] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 371.335528] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 379.466883] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 384.801915] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 391.059631] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 391.406426] Lustre: lustre-OST0000: new disk, initializing [ 391.409714] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 391.417743] Lustre: 17012:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 391.491875] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 392.527086] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 392.542419] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 392.650082] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 397.236391] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 406.332594] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 410.928117] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 411.208504] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 415.565746] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 415.792611] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 418.285237] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 418.291701] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 418.294027] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 418.294035] Lustre: Skipped 2 previous similar messages [ 418.296733] Lustre: Skipped 2 previous similar messages [ 418.321936] LustreError: Skipped 1 previous similar message [ 423.406895] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 423.414326] Lustre: Skipped 2 previous similar messages [ 424.182899] Lustre: server umount lustre-OST0000 complete [ 428.513417] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 428.515370] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 428.540885] Lustre: Skipped 1 previous similar message [ 433.633155] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 433.645281] Lustre: Skipped 2 previous similar messages [ 442.336124] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 442.503193] Lustre: server umount lustre-MDT0000 complete [ 443.876877] LustreError: 15852:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 443.894056] LustreError: 15852:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 445.900362] LustreError: 15035:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217932 with bad export cookie 18340997192785889738 [ 445.902637] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 445.911765] LustreError: 15035:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 446.243233] Lustre: server umount lustre-MDT0001 complete [ 450.847048] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 08:32:17 (1782217937) [ 456.806738] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 457.302524] LustreError: 19277:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 457.409815] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 462.282737] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 462.817554] LustreError: 19278:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 469.894984] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 475.670621] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 483.893471] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 489.820768] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 496.187551] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 502.499844] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 509.427522] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 516.563995] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 525.283520] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 525.313949] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 525.327360] Lustre: Skipped 4 previous similar messages [ 531.326558] Lustre: server umount lustre-MDT0000 complete [ 535.526460] LustreError: 19278:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 535.569663] LustreError: 19278:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 536.161186] LustreError: 19258:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218023 with bad export cookie 18340997192785890620 [ 536.170088] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 536.179505] LustreError: 19258:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 536.655273] Lustre: server umount lustre-MDT0001 complete [ 551.209618] Lustre: server umount lustre-OST0000 complete [ 572.644700] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 583.655511] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 584.204830] LustreError: 23657:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 584.276078] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 584.282114] Lustre: Skipped 2 previous similar messages [ 588.855398] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 597.961661] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 602.400335] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 605.634793] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 612.956357] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 620.754662] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 630.743942] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 630.932067] Lustre: lustre-OST0001: new disk, initializing [ 630.936725] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 630.942417] Lustre: 25970:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 632.472755] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 632.484240] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 632.698319] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 638.024489] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 648.804629] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 652.882287] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 665.058906] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 665.070238] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 665.083546] Lustre: Skipped 2 previous similar messages [ 665.087469] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 665.098917] Lustre: Skipped 3 previous similar messages [ 671.307548] Lustre: server umount lustre-MDT0000 complete [ 673.763470] LustreError: 23658:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 673.786123] LustreError: 23658:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 675.267758] LustreError: 23639:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218162 with bad export cookie 18340997192785891467 [ 675.280898] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 675.292747] LustreError: 23639:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 675.637938] Lustre: server umount lustre-MDT0001 complete [ 690.120803] Lustre: server umount lustre-OST0000 complete [ 704.693650] Lustre: server umount lustre-OST0001 complete [ 724.121911] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 735.125912] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 735.787677] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 735.792032] Lustre: Skipped 3 previous similar messages [ 740.608456] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 740.838747] LustreError: 28996:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 740.864486] LustreError: 28996:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 749.140076] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 754.814544] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 757.827460] Lustre: 30142:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 764.564561] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 771.988685] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 780.850752] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 787.327403] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 796.178141] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 800.130364] Lustre: 32024:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 806.884885] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 806.891842] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 806.897481] Lustre: Skipped 6 previous similar messages [ 806.904463] Lustre: Skipped 7 previous similar messages [ 812.884922] Lustre: server umount lustre-MDT0000 complete [ 817.674387] LustreError: 28977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218304 with bad export cookie 18340997192785892762 [ 817.689902] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 817.704896] LustreError: 28977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 818.189111] Lustre: server umount lustre-MDT0001 complete [ 833.889679] Lustre: server umount lustre-OST0000 complete [ 847.257579] Lustre: server umount lustre-OST0001 complete [ 856.264081] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 08:39:02 (1782218342) [ 883.888880] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 894.286151] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 894.623353] LustreError: 34825:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 894.651581] LustreError: 34825:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 899.390833] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 907.937557] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 912.566680] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 915.187762] Lustre: 35974:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 921.709409] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 929.299435] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 938.684025] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 945.605311] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 955.644394] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 960.895765] Lustre: 37855:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 969.698880] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 969.720880] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 969.743855] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 969.756650] Lustre: Skipped 4 previous similar messages [ 973.905629] Lustre: server umount lustre-MDT0000 complete [ 977.461849] LustreError: 34807:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218464 with bad export cookie 18340997192785893868 [ 977.480752] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 977.751971] Lustre: server umount lustre-MDT0001 complete [ 991.899488] Lustre: server umount lustre-OST0000 complete [ 1005.826244] Lustre: server umount lustre-OST0001 complete [ 1014.810107] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 08:41:41 (1782218501) [ 1032.387639] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1043.573396] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1044.104598] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1044.107797] Lustre: Skipped 7 previous similar messages [ 1048.465320] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1057.867333] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1064.097841] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1067.738355] Lustre: 41148:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1075.874041] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1082.919724] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1092.966607] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1100.941288] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1109.374653] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1113.021734] Lustre: 43024:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1113.989506] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1114.000102] Lustre: Skipped 1 previous similar message [ 1119.206693] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1119.225409] Lustre: Skipped 5 previous similar messages [ 1123.183573] Lustre: server umount lustre-MDT0000 complete [ 1127.073650] LustreError: 43027:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218614 with bad export cookie 18340997192785894974 [ 1127.099861] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1127.102767] LustreError: 43027:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 1133.689816] Lustre: server umount lustre-MDT0001 complete [ 1141.852551] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1152.993400] LustreError: 3610:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff934a7dca5c00 x1868790539624704/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1153.348689] LustreError: 41511:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1153.368463] LustreError: 41511:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 24 previous similar messages [ 1157.606714] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1162.669341] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1166.408130] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1171.112475] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1171.970205] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1171.995762] Lustre: Skipped 1 previous similar message [ 1180.283729] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1182.452810] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1188.872846] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1190.595615] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1197.546356] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1202.247827] Lustre: server umount lustre-MDT0000 complete [ 1206.037296] LustreError: 39978:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218693 with bad export cookie 18340997192785896101 [ 1206.042314] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1206.050882] LustreError: 39978:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1206.247368] Lustre: server umount lustre-MDT0001 complete [ 1219.829942] Lustre: server umount lustre-OST0000 complete [ 1223.138209] Lustre: 3611:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782218694/real 1782218694] req@ffff934a506df100 x1868790539660672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782218710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1223.376462] Lustre: server umount lustre-OST0001 complete [ 1232.508828] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 08:45:19 (1782218719) [ 1247.372575] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1257.502933] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1262.655476] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1271.074506] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1275.442923] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1278.194635] Lustre: 48782:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1284.449694] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1290.746742] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1299.417398] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1306.209628] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1313.707147] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1317.892704] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1331.650312] Lustre: server umount lustre-MDT0000 complete [ 1333.218979] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1335.302354] LustreError: 47612:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782218822 with bad export cookie 18340997192785896899 [ 1335.310100] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1335.315724] LustreError: 47612:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1335.696245] Lustre: server umount lustre-MDT0001 complete [ 1350.518803] Lustre: server umount lustre-OST0000 complete [ 1364.950325] Lustre: server umount lustre-OST0001 complete [ 1375.048846] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 08:47:41 (1782218861) [ 1377.979534] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1379.991120] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 08:47:46 (1782218866) [ 1391.147212] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 1401.296761] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1425.680274] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1426.010637] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1426.118370] Lustre: lustre-MDT0000: new disk, initializing [ 1426.267877] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1431.833257] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1441.906254] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1450.028554] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1450.285440] Lustre: lustre-OST0000: new disk, initializing [ 1450.288870] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1450.293158] Lustre: Skipped 1 previous similar message [ 1450.306533] Lustre: 54863:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1451.797927] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1451.805834] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1451.836239] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1456.672078] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1465.232771] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1467.124903] Lustre: DEBUG MARKER: create test files [ 1498.084163] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1498.091906] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1498.112936] Lustre: Skipped 12 previous similar messages [ 1498.119333] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1498.123625] Lustre: Skipped 18 previous similar messages [ 1503.403691] Lustre: server umount lustre-OST0000 complete [ 1506.833295] Lustre: server umount lustre-MDT0000 complete [ 1517.839439] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 1521.261878] Key type lgssc unregistered [ 1521.606130] LNet: 56493:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1521.620731] LNetError: 56493:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1522.671030] LNet: Removed LNI 192.168.203.158@tcp [ 1523.696248] Key type .llcrypt unregistered [ 1523.697990] Key type ._llcrypt unregistered [ 1549.297658] Key type ._llcrypt registered [ 1549.300445] Key type .llcrypt registered [ 1549.409846] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1550.327453] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1550.349514] alg: No test for adler32 (adler32-zlib) [ 1551.532788] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 1551.773262] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 1553.464177] Key type lgssc registered [ 1554.419264] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1560.920373] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1560.941270] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1562.362044] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1567.225801] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1573.573679] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1579.770497] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1580.114956] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1586.248285] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1587.337468] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:100 to 0x240000400:129) [ 1587.415948] Lustre: 59206:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1587.434493] Lustre: 59206:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1587.447852] Lustre: 59206:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1587.456815] Lustre: 59206:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1587.462818] Lustre: 59206:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1587.469346] Lustre: 59206:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1593.455134] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1598.443102] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1603.593540] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1612.501883] Lustre: server umount lustre-OST0000 complete [ 1626.729143] Lustre: server umount lustre-MDT0000 complete [ 1637.166757] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 1639.738324] Key type lgssc unregistered [ 1640.030798] LNet: 60818:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1640.042351] LNetError: 60818:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1640.060280] LNet: Removed LNI 192.168.203.158@tcp [ 1640.921722] Key type .llcrypt unregistered [ 1640.926393] Key type ._llcrypt unregistered [ 1667.791501] Key type ._llcrypt registered [ 1667.797732] Key type .llcrypt registered [ 1667.895255] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1668.834900] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1668.863361] alg: No test for adler32 (adler32-zlib) [ 1669.922988] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 1670.157078] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 1671.824223] Key type lgssc registered [ 1672.985790] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1680.041510] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1680.063562] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1681.485582] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1685.456328] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1692.439781] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1698.985316] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1699.296300] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1705.218791] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1706.487698] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1706.594705] Lustre: 63635:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1706.602428] Lustre: 63635:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1706.608725] Lustre: 63635:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1706.620556] Lustre: 63635:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1706.633867] Lustre: 63635:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1706.640840] Lustre: 63635:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1714.092712] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1720.287796] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1732.068944] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1732.069887] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1732.094368] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1736.516163] Lustre: server umount lustre-OST0000 complete [ 1740.620038] Lustre: server umount lustre-MDT0000 complete [ 1752.470881] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 1755.304226] Key type lgssc unregistered [ 1755.666590] LNet: 65194:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1755.673046] LNetError: 65194:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1755.686660] LNet: Removed LNI 192.168.203.158@tcp [ 1756.540326] Key type .llcrypt unregistered [ 1756.542514] Key type ._llcrypt unregistered [ 1775.227865] Key type ._llcrypt registered [ 1775.229481] Key type .llcrypt registered [ 1775.359646] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 1793.077782] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1794.692821] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1794.778821] alg: No test for adler32 (adler32-zlib) [ 1796.184333] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 1796.632934] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 1798.362982] Key type lgssc registered [ 1799.966990] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1838.220251] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1838.242590] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1839.580581] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1839.626915] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1839.746370] Lustre: lustre-MDT0000: new disk, initializing [ 1839.898226] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1839.927023] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1844.798955] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1855.932396] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1856.027708] Lustre: 68349:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1856.108828] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1856.111875] Lustre: Skipped 1 previous similar message [ 1856.178166] Lustre: lustre-MDT0001: new disk, initializing [ 1856.251739] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1856.293294] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1856.313943] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1860.852702] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1870.885233] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1877.064710] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1883.654062] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1884.025977] Lustre: lustre-OST0000: new disk, initializing [ 1884.028734] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1884.037799] Lustre: 70315:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1884.143912] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1890.992657] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 1891.355953] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1891.373116] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1891.478056] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1900.782527] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1905.058132] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1905.386179] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1910.125542] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1910.357923] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1912.292561] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1912.299322] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1912.303709] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1912.309049] Lustre: Skipped 1 previous similar message [ 1917.411642] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1917.415253] Lustre: Skipped 1 previous similar message [ 1918.558341] Lustre: server umount lustre-OST0000 complete [ 1922.530109] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1922.532288] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1922.549088] Lustre: Skipped 1 previous similar message [ 1922.553247] Lustre: Skipped 1 previous similar message [ 1927.650516] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1927.659233] Lustre: Skipped 2 previous similar messages [ 1928.585271] Lustre: server umount lustre-MDT0000 complete [ 1931.725959] LustreError: 68339:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782219418 with bad export cookie 4434767163105580741 [ 1931.732130] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1931.739343] LustreError: 68339:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1932.126571] Lustre: server umount lustre-MDT0001 complete [ 1939.991609] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 08:57:06 (1782219426) [ 1951.030766] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 1994.899518] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 2006.123427] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 2045.121890] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2045.463864] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2045.504791] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2045.608794] Lustre: lustre-MDT0000: new disk, initializing [ 2045.717735] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2045.735243] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2050.493318] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2061.392520] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2061.497169] Lustre: 76335:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2061.549514] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2061.559295] Lustre: Skipped 1 previous similar message [ 2061.684199] Lustre: lustre-MDT0001: new disk, initializing [ 2061.799126] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2061.849776] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2061.861410] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2065.597652] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2074.537934] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2081.753230] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2090.129288] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2090.460986] Lustre: lustre-OST0000: new disk, initializing [ 2090.464987] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2090.491900] Lustre: 78304:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2090.621636] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2096.212043] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2096.220945] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2096.350394] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2096.869994] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2105.293390] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2109.769298] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2110.013990] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2115.060825] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2115.257544] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2122.211977] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2122.212350] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2122.219316] LustreError: Skipped 1 previous similar message [ 2122.223426] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2122.250357] Lustre: Skipped 1 previous similar message [ 2122.276532] Lustre: Skipped 1 previous similar message [ 2123.577969] Lustre: server umount lustre-OST0000 complete [ 2128.360868] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2128.369341] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2132.450606] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2132.452567] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2132.463021] Lustre: Skipped 1 previous similar message [ 2134.030253] Lustre: server umount lustre-MDT0000 complete [ 2137.734642] LustreError: 76326:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782219624 with bad export cookie 4434767163105581623 [ 2137.740692] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2137.748719] LustreError: 76326:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2138.140497] Lustre: server umount lustre-MDT0001 complete [ 2146.518821] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 09:00:32 (1782219632) [ 2153.320420] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2153.836728] LustreError: 80715:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2153.866372] LustreError: 80715:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2153.907733] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2158.476479] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2159.087261] LustreError: 80716:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2163.172249] LustreError: 80715:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2166.627152] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2171.720431] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2179.171889] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2185.418858] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2194.228243] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2194.495891] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2194.501864] Lustre: Skipped 1 previous similar message [ 2203.518294] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2212.563554] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2216.526052] Lustre: 83397:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 32271a7a-5819-46ff-9ebd-58927cbb5943 at adminstrative request [ 2216.936245] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2216.949387] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2226.146742] Lustre: MGS: Client 32271a7a-5819-46ff-9ebd-58927cbb5943 (at 0@lo) reconnecting [ 2226.153590] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x3d8b753d0a799da9 to 0x3d8b753d0a79a049 [ 2226.162049] Lustre: MGC192.168.203.158@tcp: Connection restored to 0@lo (at 0@lo) [ 2254.917418] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2255.077664] Lustre: lustre-OST0001: new disk, initializing [ 2255.081608] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2255.086525] Lustre: 83791:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2262.240236] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2262.254318] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2262.373834] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2262.476321] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2272.900779] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2277.862489] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2277.874488] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2277.883237] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2277.893019] Lustre: Skipped 1 previous similar message [ 2277.909186] Lustre: Skipped 2 previous similar messages [ 2282.659922] Lustre: server umount lustre-OST0001 complete [ 2282.985801] LustreError: 83419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2282.994989] LustreError: 83419:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2288.100525] LustreError: 82548:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2288.128250] LustreError: 82548:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2293.029448] Lustre: server umount lustre-OST0000 complete [ 2298.337576] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2298.362702] Lustre: Skipped 2 previous similar messages [ 2302.684750] Lustre: server umount lustre-MDT0000 complete [ 2303.460169] LustreError: 81727:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2303.485526] LustreError: 81727:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2306.690609] LustreError: 83801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782219793 with bad export cookie 4434767163105583177 [ 2306.695737] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2306.715297] LustreError: 83801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2307.226200] Lustre: server umount lustre-MDT0001 complete [ 2315.748490] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 09:03:22 (1782219802) [ 2318.178771] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2320.316975] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 09:03:26 (1782219806) [ 2322.156675] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2323.811916] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 09:03:30 (1782219810) [ 2325.493312] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2327.610471] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 09:03:33 (1782219813) [ 2329.657860] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2331.617518] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 09:03:37 (1782219817) [ 2333.023409] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2339.489479] loop: module loaded [ 2339.516935] loop0: detected capacity change from 0 to 4294967296 [ 2339.595118] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2341.154443] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2344.511310] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2346.970943] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2376.599082] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2376.663599] LustreError: 87917:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2376.669266] LustreError: 87917:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2376.685893] LustreError: 87917:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2376.697459] LustreError: 87917:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2400.588362] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 2410.025519] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 2447.408994] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2447.724545] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2447.748304] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2447.808477] Lustre: lustre-MDT0000: new disk, initializing [ 2447.882739] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2447.894943] Lustre: Skipped 1 previous similar message [ 2447.907124] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2452.645244] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2463.749402] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2463.891632] Lustre: 90784:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2464.243174] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2468.698149] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2478.815122] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2484.534811] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2492.425931] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2492.655161] Lustre: 92752:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2498.641463] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2500.715393] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2500.887040] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2507.773593] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2512.153820] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2512.343727] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2517.395896] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2517.681535] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2521.576615] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2521.583646] LustreError: Skipped 1 previous similar message [ 2521.586716] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2521.593862] Lustre: Skipped 1 previous similar message [ 2521.615766] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2521.632176] Lustre: Skipped 5 previous similar messages [ 2534.368106] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2534.498592] Lustre: server umount lustre-OST0000 complete [ 2541.027040] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2541.036687] LustreError: Skipped 1 previous similar message [ 2552.288251] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2552.507622] Lustre: server umount lustre-MDT0000 complete [ 2556.341341] LustreError: 92763:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782220043 with bad export cookie 4434767163105583793 [ 2556.347551] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2556.352419] LustreError: 92763:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2556.808474] Lustre: server umount lustre-MDT0001 complete [ 2566.224993] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 09:07:32 (1782220052) [ 2572.825473] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2573.185895] LustreError: 95168:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2577.932280] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2586.716436] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2587.007093] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 2587.011930] Lustre: Skipped 3 previous similar messages [ 2591.011704] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2598.586387] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2605.045785] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2612.790396] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2628.698599] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2637.150469] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2640.535611] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2640.941785] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2644.783719] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2644.931504] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2648.838023] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2648.935995] Lustre: lustre-OST0001: new disk, initializing [ 2648.941098] Lustre: Skipped 2 previous similar messages [ 2648.945033] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2648.949413] Lustre: Skipped 3 previous similar messages [ 2648.952597] Lustre: 98538:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2654.769493] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2658.945368] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2658.953789] Lustre: Skipped 2 previous similar messages [ 2658.959182] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2659.078629] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2664.099649] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2668.561641] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2668.795445] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2673.306451] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2673.501664] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2693.231587] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2718.354047] Lustre: Failing over lustre-MDT0000 [ 2718.918267] Lustre: server umount lustre-MDT0000 complete [ 2720.227963] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2720.246162] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2720.268265] Lustre: Skipped 2 previous similar messages [ 2720.284884] LustreError: 95169:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2720.313051] LustreError: 95169:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2736.100499] Lustre: 66570:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782220207/real 1782220207] req@00000000987c893f x1868792367165184/t0(0) o400->MGC192.168.203.158@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1782220223 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2736.128957] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2744.434985] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2744.442898] LDISKFS-fs (dm-0): recovery complete [ 2744.460479] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2746.868511] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2749.304548] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2749.307542] Lustre: 100147:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2751.978263] Lustre: 95897:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2751.985992] Lustre: 95897:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 1 previous similar message [ 2752.003813] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2752.097870] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2752.229484] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2752.438857] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2752.780478] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2752.787443] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 2753.112369] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2753.126101] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 2753.153386] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2753.172082] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 7 previous similar messages [ 2753.810625] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2753.828682] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 2 previous similar messages [ 2754.191462] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2754.203307] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 2 previous similar messages [ 2755.178233] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2755.202342] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 5 previous similar messages [ 2755.850813] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2755.864697] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 5 previous similar messages [ 2756.196154] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2756.210527] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 5 previous similar messages [ 2759.446186] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2759.462765] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 12 previous similar messages [ 2760.124153] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2760.141842] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 2760.480172] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2760.488867] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 2767.523910] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2767.544660] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 24 previous similar messages [ 2768.210951] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2768.230040] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 24 previous similar messages [ 2768.562372] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2768.577434] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 24 previous similar messages [ 2783.583679] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2783.595869] Lustre: 101386:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 49 previous similar messages [ 2784.249517] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2784.260861] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 49 previous similar messages [ 2784.584214] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2784.592630] LustreError: 101386:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 49 previous similar messages [ 2809.050089] Lustre: 101386:0:(ldlm_lib.c:2380:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2809.064593] Lustre: 101386:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2809.090736] Lustre: 101386:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 0a444c35-69a3-417e-92c4-943d575bef19@192.168.203.58@tcp [ 2809.114852] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2809.132300] Lustre: 101386:0:(ldlm_lib.c:1900:abort_req_replay_queue()) @@@ aborted: req@00000000210f2eba x1868792349135232/t0(8589934774) o35->0a444c35-69a3-417e-92c4-943d575bef19@192.168.203.58@tcp:526/0 lens 392/0 e 0 to 0 dl 1782220306 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2809.200492] Lustre: lustre-MDT0000: Denying connection for new client 0a444c35-69a3-417e-92c4-943d575bef19 (at 192.168.203.58@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2809.206479] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2809.236318] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2809.292795] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2809.301288] Lustre: Skipped 2 previous similar messages [ 2809.319767] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2809.360512] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 2809.361181] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 2828.781578] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2828.787194] Lustre: Skipped 12 previous similar messages [ 2834.771427] Lustre: server umount lustre-OST0000 complete [ 2839.020824] LustreError: 96992:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2839.042164] LustreError: 96992:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 36 previous similar messages [ 2844.921401] Lustre: server umount lustre-OST0001 complete [ 2849.249361] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2849.270889] Lustre: Skipped 8 previous similar messages [ 2855.504844] Lustre: server umount lustre-MDT0000 complete [ 2859.009691] LustreError: 98537:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782220346 with bad export cookie 4434767163105635005 [ 2859.020146] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2859.025099] LustreError: 98537:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2859.549357] Lustre: server umount lustre-MDT0001 complete [ 2869.016105] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 09:12:35 (1782220355) [ 2875.884230] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2875.892710] Lustre: *** cfs_fail_loc=197, val=0*** [ 2891.555257] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2896.672518] LustreError: 103363:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.158@tcp: failed processing log, type 4: rc = -110 [ 2901.816206] Lustre: *** cfs_fail_loc=197, val=0*** [ 2901.818682] Lustre: Skipped 65 previous similar messages [ 2922.400863] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2922.412535] Lustre: Skipped 3 previous similar messages [ 2928.626303] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2935.108722] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2936.860522] Lustre: server umount lustre-OST0000 complete [ 2945.576646] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 09:13:51 (1782220431) [ 2966.287503] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2967.142662] LustreError: 104982:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2967.168191] LustreError: 104982:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2972.362198] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 2983.930859] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2988.499102] LustreError: 105013:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2988.519000] LustreError: 105013:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2988.536541] LustreError: 105013:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 21, retries 0, failed: rc = -5 [ 2988.828479] Lustre: server umount lustre-MDT0000 complete [ 3026.030100] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 3036.786371] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 3076.136592] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3076.407454] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3076.469953] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3076.576937] Lustre: lustre-MDT0000: new disk, initializing [ 3076.727400] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3081.938256] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3093.209305] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3093.385818] Lustre: 109190:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3093.658802] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3098.805232] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3109.559313] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3115.871436] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3122.748605] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3123.063664] Lustre: 111159:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3129.067502] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3131.606508] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3140.292744] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3146.113290] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3146.384342] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3151.641991] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3151.881793] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3157.480257] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3157.486097] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3157.518608] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3157.518617] Lustre: Skipped 10 previous similar messages [ 3157.548803] LustreError: Skipped 1 previous similar message [ 3160.011400] Lustre: server umount lustre-OST0000 complete [ 3170.603697] Lustre: server umount lustre-MDT0000 complete [ 3174.889450] LustreError: 111158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782220661 with bad export cookie 4434767163105645645 [ 3174.903657] LustreError: 111158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3174.905443] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3175.418336] Lustre: server umount lustre-MDT0001 complete [ 3184.725911] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 09:17:51 (1782220671) [ 3193.311528] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 3196.079816] Key type lgssc unregistered [ 3196.394918] LNet: 113646:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3196.399504] LNetError: 113646:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3196.438465] LNet: Removed LNI 192.168.203.158@tcp [ 3197.328633] Key type .llcrypt unregistered [ 3197.332940] Key type ._llcrypt unregistered [ 3214.781560] Key type ._llcrypt registered [ 3214.789233] Key type .llcrypt registered [ 3214.938138] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 3235.212935] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 3236.256287] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3236.331258] alg: No test for adler32 (adler32-zlib) [ 3237.509217] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 3237.889861] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 3239.600162] Key type lgssc registered [ 3241.478773] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3285.065508] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3285.105837] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3286.369530] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3286.449266] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3286.586294] Lustre: lustre-MDT0000: new disk, initializing [ 3286.690934] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3286.737974] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3291.812514] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3302.623095] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3302.869250] Lustre: lustre-OST0000: new disk, initializing [ 3302.884713] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3302.899879] Lustre: Skipped 1 previous similar message [ 3302.907996] Lustre: 117822:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3302.980590] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3309.154626] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3309.175132] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3309.214914] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3309.623609] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3321.104283] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3321.325138] Lustre: lustre-OST0001: new disk, initializing [ 3321.334877] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3321.347744] Lustre: 118687:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3321.540991] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3327.136587] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3327.149317] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3327.191972] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3329.337651] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3342.309802] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3342.337429] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3342.352986] Lustre: Skipped 1 previous similar message [ 3346.590111] Lustre: server umount lustre-MDT0000 complete [ 3353.618350] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3358.252054] LustreError: 117008:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782220845 with bad export cookie 14799242618456501171 [ 3358.258652] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3358.266820] LustreError: 117008:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3358.400488] Lustre: server umount lustre-OST0000 complete [ 3362.208973] Lustre: server umount lustre-OST0001 complete [ 3372.282865] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 09:20:58 (1782220858) [ 3381.890692] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 3408.674282] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 09:21:34 (1782220894) [ 3452.184433] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 3461.857680] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 3501.702283] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3502.044267] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3502.079564] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3502.153503] Lustre: lustre-MDT0000: new disk, initializing [ 3502.228681] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3502.250246] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3506.966730] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3518.277728] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3518.400940] Lustre: 125436:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3518.451986] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3518.455402] Lustre: Skipped 1 previous similar message [ 3518.531542] Lustre: lustre-MDT0001: new disk, initializing [ 3518.623640] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3518.671144] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3518.683559] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3523.396764] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3533.440960] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3539.622435] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3546.514042] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3546.759847] Lustre: lustre-OST0000: new disk, initializing [ 3546.768864] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3546.781321] Lustre: 127406:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3546.870535] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3552.830941] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3552.845955] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3552.963832] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3552.994300] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3565.406484] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3571.864377] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3572.141296] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3578.021992] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3578.302570] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3583.971358] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3583.974091] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3584.007730] Lustre: Skipped 1 previous similar message [ 3584.014097] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3584.014220] LustreError: Skipped 1 previous similar message [ 3584.053945] Lustre: Skipped 1 previous similar message [ 3586.791352] Lustre: server umount lustre-OST0000 complete [ 3594.209277] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3594.212695] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3594.234137] Lustre: Skipped 2 previous similar messages [ 3594.255513] Lustre: Skipped 1 previous similar message [ 3597.521662] Lustre: server umount lustre-MDT0000 complete [ 3601.938444] LustreError: 125429:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782221088 with bad export cookie 14799242618456502389 [ 3601.942096] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3601.955966] LustreError: 125429:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3602.375711] Lustre: server umount lustre-MDT0001 complete [ 3612.538845] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 09:24:58 (1782221098) [ 3621.538389] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3622.072069] LustreError: 129820:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3622.084706] LustreError: 129820:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3622.137657] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3627.489083] LustreError: 129821:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3627.530320] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3632.612210] LustreError: 129820:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3637.732369] LustreError: 129821:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3638.054735] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3643.733712] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3652.919241] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3659.846893] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3667.868080] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3668.234569] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3668.237132] Lustre: Skipped 1 previous similar message [ 3675.126185] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3683.027676] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3700.093550] Lustre: *** cfs_fail_loc=159, val=0*** [ 3716.574495] Lustre: lustre-MDT0000: Client 4f91b7fc-429d-43c4-a662-3c00b8c6f2c4 (at 192.168.203.58@tcp) reconnecting [ 3718.393159] Lustre: *** cfs_fail_loc=159, val=0*** [ 3718.399323] Lustre: Skipped 5 previous similar messages [ 3734.927795] Lustre: lustre-MDT0000: Client 4f91b7fc-429d-43c4-a662-3c00b8c6f2c4 (at 192.168.203.58@tcp) reconnecting [ 3754.469078] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3754.478846] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3754.501347] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3754.509679] Lustre: Skipped 1 previous similar message [ 3758.009766] Lustre: server umount lustre-OST0000 complete [ 3764.706527] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3764.715822] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3764.724517] Lustre: Skipped 2 previous similar messages [ 3764.742581] Lustre: Skipped 1 previous similar message [ 3768.324270] Lustre: server umount lustre-MDT0000 complete [ 3769.834834] LustreError: 129816:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3769.858672] LustreError: 129816:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3772.576865] LustreError: 129802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782221259 with bad export cookie 14799242618456503278 [ 3772.577205] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3772.603662] LustreError: 129802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3773.276872] Lustre: server umount lustre-MDT0001 complete [ 3786.565978] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 3789.606059] Key type lgssc unregistered [ 3789.931568] LNet: 133622:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3789.948943] LNetError: 133622:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3789.966821] LNet: Removed LNI 192.168.203.158@tcp [ 3790.810307] Key type .llcrypt unregistered [ 3790.817232] Key type ._llcrypt unregistered [ 3815.715672] Key type ._llcrypt registered [ 3815.718136] Key type .llcrypt registered [ 3815.800924] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 3816.736762] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3816.905068] alg: No test for adler32 (adler32-zlib) [ 3818.150718] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 3818.468529] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 3820.168186] Key type lgssc registered [ 3821.386302] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3830.374686] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3830.390873] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3831.838479] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3836.632769] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3842.020315] LustreError: 135035:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3842.043295] LustreError: 135035:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3845.766520] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3846.345534] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3851.268272] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3859.465880] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3866.275224] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3873.587993] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3874.003733] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3877.125189] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3881.373680] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 3889.798445] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3900.996502] Lustre: *** cfs_fail_loc=159, val=0*** [ 3916.217461] Lustre: lustre-MDT0000: Client aef7a459-d247-43b8-b6a6-97b97da68bae (at 192.168.203.58@tcp) reconnecting [ 3919.056440] Lustre: *** cfs_fail_loc=159, val=0*** [ 3919.062027] Lustre: Skipped 1 previous similar message [ 3934.647293] Lustre: lustre-MDT0001: Client aef7a459-d247-43b8-b6a6-97b97da68bae (at 192.168.203.58@tcp) reconnecting [ 3936.611571] Lustre: *** cfs_fail_loc=159, val=0*** [ 3936.620107] Lustre: Skipped 2 previous similar messages [ 3953.079635] Lustre: lustre-MDT0001: Client aef7a459-d247-43b8-b6a6-97b97da68bae (at 192.168.203.58@tcp) reconnecting [ 3958.535361] Lustre: 138072:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3961.287147] Lustre: *** cfs_fail_loc=159, val=0*** [ 3961.288626] Lustre: Skipped 4 previous similar messages [ 3977.656865] Lustre: lustre-MDT0000: Client c5ef4ae3-52d2-43ec-830b-39313388bc88 (at 192.168.203.58@tcp) reconnecting [ 3979.668895] Lustre: *** cfs_fail_loc=159, val=0*** [ 3979.670748] Lustre: Skipped 14 previous similar messages [ 3996.066292] Lustre: lustre-MDT0000: Client c5ef4ae3-52d2-43ec-830b-39313388bc88 (at 192.168.203.58@tcp) reconnecting [ 3997.789858] Lustre: 138369:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4003.818705] LustreError: lustre-OST0000-osc-MDT0001: operation ost_destroy to node 0@lo failed: rc = -107 [ 4003.835994] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4003.872404] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4009.445852] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4009.463978] Lustre: Skipped 3 previous similar messages [ 4009.807765] Lustre: server umount lustre-OST0000 complete [ 4014.563295] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4014.582041] Lustre: Skipped 1 previous similar message [ 4014.587093] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4014.590292] Lustre: Skipped 1 previous similar message [ 4019.684866] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4019.692780] Lustre: Skipped 1 previous similar message [ 4020.309991] Lustre: server umount lustre-MDT0000 complete [ 4024.240124] LustreError: 135015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782221511 with bad export cookie 8846389950987217455 [ 4024.241471] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4024.258273] LustreError: 135015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4024.701675] Lustre: server umount lustre-MDT0001 complete [ 4036.652634] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 4039.699395] Key type lgssc unregistered [ 4039.965463] LNet: 139421:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4039.975117] LNetError: 139421:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4039.987706] LNet: Removed LNI 192.168.203.158@tcp [ 4040.521091] Key type .llcrypt unregistered [ 4040.524775] Key type ._llcrypt unregistered [ 4064.358645] Key type ._llcrypt registered [ 4064.361132] Key type .llcrypt registered [ 4064.464840] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 4065.389372] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4065.441185] alg: No test for adler32 (adler32-zlib) [ 4066.503531] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 4066.699258] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 4068.403102] Key type lgssc registered [ 4069.607317] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4077.112644] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4077.129804] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4078.595264] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4083.004525] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4088.807964] LustreError: 140835:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4088.824842] LustreError: 140835:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4091.284365] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4091.730734] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4096.358158] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4105.369716] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4112.572660] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4120.351436] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4120.775107] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4123.870286] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4127.835445] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4135.337241] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4136.126851] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4142.572572] Lustre: 143422:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4146.314082] Lustre: 143470:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4147.797326] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4148.738707] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4152.719565] Lustre: 143616:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4153.536315] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4154.559469] Lustre: 143714:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4159.969487] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4159.985070] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4160.006620] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4162.028049] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4162.033742] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4162.037065] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4167.139951] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4167.146626] Lustre: Skipped 2 previous similar messages [ 4172.272625] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4172.283486] Lustre: Skipped 1 previous similar message [ 4173.281176] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4173.432359] Lustre: server umount lustre-OST0000 complete [ 4177.379871] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4177.390914] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4177.396790] Lustre: Skipped 1 previous similar message [ 4183.788646] Lustre: server umount lustre-MDT0000 complete [ 4187.416622] LustreError: 140818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782221674 with bad export cookie 8943714840598345744 [ 4187.431839] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4187.441391] LustreError: 140818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4187.807334] Lustre: server umount lustre-MDT0001 complete [ 4198.369238] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 4201.443736] Key type lgssc unregistered [ 4201.771895] LNet: 144776:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4201.778728] LNetError: 144776:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4201.805932] LNet: Removed LNI 192.168.203.158@tcp [ 4202.558386] Key type .llcrypt unregistered [ 4202.562414] Key type ._llcrypt unregistered [ 4227.616225] Key type ._llcrypt registered [ 4227.634570] Key type .llcrypt registered [ 4227.780380] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 4228.926990] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4228.991516] alg: No test for adler32 (adler32-zlib) [ 4230.062295] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 4230.308580] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 4232.080303] Key type lgssc registered [ 4233.272868] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4241.219214] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4241.242026] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4242.770857] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4247.151951] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4252.132941] LustreError: 146192:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4252.162986] LustreError: 146192:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4255.769386] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4256.233280] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4260.711822] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4267.893286] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4274.631655] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4281.613612] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4281.765016] LustreError: 148016:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4282.075985] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4287.244342] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4287.257950] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4289.202599] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4296.568256] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4303.532115] Lustre: *** cfs_fail_loc=159, val=0*** [ 4319.172379] Lustre: lustre-MDT0000: Client a4e0baac-e188-4af4-b1ee-52d98d144b3b (at 192.168.203.58@tcp) reconnecting [ 4338.662247] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4338.670679] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4338.692602] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4338.698430] Lustre: Skipped 1 previous similar message [ 4343.122914] Lustre: server umount lustre-OST0000 complete [ 4348.386594] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4348.400147] LustreError: Skipped 1 previous similar message [ 4348.404707] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4348.422605] Lustre: Skipped 1 previous similar message [ 4348.427552] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4353.220627] Lustre: server umount lustre-MDT0000 complete [ 4354.018754] LustreError: 146187:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4354.035231] LustreError: 146187:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4356.604424] LustreError: 146174:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782221843 with bad export cookie 6738844515229720694 [ 4356.612200] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4356.618701] LustreError: 146174:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4356.988387] Lustre: server umount lustre-MDT0001 complete [ 4368.199402] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 4371.065514] Key type lgssc unregistered [ 4371.349086] LNet: 149856:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4371.359177] LNetError: 149856:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4371.390690] LNet: Removed LNI 192.168.203.158@tcp [ 4372.240343] Key type .llcrypt unregistered [ 4372.244450] Key type ._llcrypt unregistered [ 4396.585882] Key type ._llcrypt registered [ 4396.588226] Key type .llcrypt registered [ 4396.675387] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 4397.876633] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4397.894206] alg: No test for adler32 (adler32-zlib) [ 4398.901815] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 4399.092818] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 4400.784351] Key type lgssc registered [ 4402.017912] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4409.651171] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4409.662758] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4411.059385] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4415.150281] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4420.588242] LustreError: 151274:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4420.606126] LustreError: 151274:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4423.850041] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4424.351862] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4428.953389] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4435.950702] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4441.591349] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4449.248643] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4449.672161] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4455.762542] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4455.868699] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4463.742614] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4469.171575] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4488.703685] Lustre: lustre-OST0000: evicting 217d5fbf-c7ef-4db2-819b-b61db7509880 (at 192.168.203.58@tcp) by administrative request [ 4488.713190] Lustre: Skipped 1 previous similar message [ 4517.345928] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4517.353120] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4517.385563] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4520.418179] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4520.419970] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4520.433477] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4520.463534] Lustre: Skipped 1 previous similar message [ 4523.559317] Lustre: server umount lustre-OST0000 complete [ 4530.658625] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4530.662704] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4530.671466] Lustre: Skipped 1 previous similar message [ 4534.309821] Lustre: server umount lustre-MDT0000 complete [ 4535.777378] LustreError: 151274:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4535.792160] LustreError: 151274:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4537.978231] LustreError: 151256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222024 with bad export cookie 8017412117027660107 [ 4537.982224] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4537.987029] LustreError: 151256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4538.218819] Lustre: server umount lustre-MDT0001 complete [ 4554.517615] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 4557.642578] Key type lgssc unregistered [ 4557.988872] LNet: 155344:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4558.007353] LNetError: 155344:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4558.027150] LNet: Removed LNI 192.168.203.158@tcp [ 4559.375573] Key type .llcrypt unregistered [ 4559.385211] Key type ._llcrypt unregistered [ 4642.655831] Key type ._llcrypt registered [ 4642.660690] Key type .llcrypt registered [ 4642.758937] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 4643.950530] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4643.959454] alg: No test for adler32 (adler32-zlib) [ 4645.062404] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 4645.292379] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 4647.024228] Key type lgssc registered [ 4648.367142] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4656.790909] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4656.829112] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4658.592733] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4663.906749] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4668.897793] LustreError: 157833:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4668.929918] LustreError: 157833:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4674.018181] LustreError: 157834:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4674.460414] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4675.171211] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4680.947369] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4690.284113] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4696.900386] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4704.090320] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4704.580175] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4711.447908] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4719.903089] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4721.011251] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4728.176415] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4741.602049] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4741.611064] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4741.650531] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4743.659143] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4743.672604] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4743.682736] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4743.718613] Lustre: Skipped 1 previous similar message [ 4744.987168] Lustre: server umount lustre-OST0000 complete [ 4751.846462] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4751.857437] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4751.902485] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4753.896679] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4753.918187] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4753.920859] Lustre: Skipped 1 previous similar message [ 4755.512470] Lustre: server umount lustre-MDT0000 complete [ 4759.012527] LustreError: 157830:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4759.029503] LustreError: 157830:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4759.639606] LustreError: 159688:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222246 with bad export cookie 9008828646254614064 [ 4759.641455] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4759.648613] LustreError: 159688:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4760.087375] Lustre: server umount lustre-MDT0001 complete [ 4772.984194] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 4776.069280] Key type lgssc unregistered [ 4776.409647] LNet: 161407:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4776.423702] LNetError: 161407:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4777.448270] LNet: Removed LNI 192.168.203.158@tcp [ 4778.309994] Key type .llcrypt unregistered [ 4778.312368] Key type ._llcrypt unregistered [ 4806.371357] Key type ._llcrypt registered [ 4806.378212] Key type .llcrypt registered [ 4806.524732] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 4808.073389] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4808.098834] alg: No test for adler32 (adler32-zlib) [ 4809.282512] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 4809.547212] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 4811.296149] Key type lgssc registered [ 4812.574587] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4829.528697] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 09:45:15 (1782222315) [ 4848.805723] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 4859.254049] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 4906.022929] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4906.058833] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4907.417846] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4907.490368] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4907.651415] Lustre: lustre-MDT0000: new disk, initializing [ 4907.757622] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4907.780100] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4912.848640] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4927.085079] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4927.237831] Lustre: 165682:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4927.307445] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4927.312075] Lustre: Skipped 1 previous similar message [ 4927.448358] Lustre: lustre-MDT0001: new disk, initializing [ 4927.600558] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4927.686106] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4927.698380] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4933.213543] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4944.883746] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4953.292287] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4960.756236] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4961.046197] Lustre: lustre-OST0000: new disk, initializing [ 4961.051577] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4961.067804] Lustre: 167650:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4961.221911] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4968.117706] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 4971.128289] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4971.147916] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4971.272031] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4980.407847] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4997.093465] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4997.097119] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4997.123784] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4997.137460] Lustre: Skipped 1 previous similar message [ 4999.265839] Lustre: server umount lustre-OST0000 complete [ 5004.257662] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5004.272901] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5004.293059] Lustre: Skipped 1 previous similar message [ 5004.308329] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5007.333833] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5007.337281] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5007.358753] Lustre: Skipped 1 previous similar message [ 5009.845800] Lustre: server umount lustre-MDT0000 complete [ 5014.659931] LustreError: 165674:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222501 with bad export cookie 1364275395222291054 [ 5014.682232] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5015.252802] Lustre: server umount lustre-MDT0001 complete [ 5026.672404] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 5029.975198] Key type lgssc unregistered [ 5030.274868] LNet: 169556:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5030.283303] LNetError: 169556:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5030.298059] LNet: Removed LNI 192.168.203.158@tcp [ 5031.271298] Key type .llcrypt unregistered [ 5031.276811] Key type ._llcrypt unregistered [ 5059.501902] Key type ._llcrypt registered [ 5059.508255] Key type .llcrypt registered [ 5059.617305] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 5061.140875] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5061.237448] alg: No test for adler32 (adler32-zlib) [ 5062.378321] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 5062.712344] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 5064.401057] Key type lgssc registered [ 5065.592769] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5073.974389] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5074.019973] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5075.528828] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5080.760111] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 5085.671991] LustreError: 170972:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5085.701553] LustreError: 170972:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5090.190274] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5090.695807] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5095.249409] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 5103.080210] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5108.582484] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5114.923597] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5115.310895] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5120.506584] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5121.716429] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 5129.417937] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5135.654750] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5135.673566] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5135.691872] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5135.706475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.719981] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5136.645493] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5136.664126] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5136.683284] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5136.688687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.702447] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5137.717545] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5137.741662] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5137.773506] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5137.783354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.801797] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5138.787768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.690050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.532788] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5140.539143] Lustre: Skipped 2 previous similar messages [ 5140.555124] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5140.565162] Lustre: Skipped 2 previous similar messages [ 5140.569695] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5140.574721] Lustre: Skipped 2 previous similar messages [ 5140.578758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.586590] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5140.589500] Lustre: Skipped 2 previous similar messages [ 5141.509707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.396571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.269506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.282791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.513913] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5145.520503] Lustre: Skipped 4 previous similar messages [ 5145.542156] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5145.557875] Lustre: Skipped 4 previous similar messages [ 5145.570589] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5145.576336] Lustre: Skipped 4 previous similar messages [ 5145.586069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.599120] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5145.606714] Lustre: Skipped 4 previous similar messages [ 5146.624381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.483605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.307029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.222655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.149659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.078791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.022520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.882042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.785521] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5153.795078] Lustre: Skipped 8 previous similar messages [ 5153.814320] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5153.831114] Lustre: Skipped 8 previous similar messages [ 5153.837323] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5153.840654] Lustre: Skipped 8 previous similar messages [ 5153.845532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.861793] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5153.873806] Lustre: Skipped 8 previous similar messages [ 5154.788332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.772119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.555379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.503125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.418926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.331080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.129091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.018415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.815385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.810590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.635502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.514558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.368449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.139171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.023155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.924434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.863963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.754265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.711408] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5170.718453] Lustre: Skipped 18 previous similar messages [ 5170.733941] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5170.745686] Lustre: Skipped 18 previous similar messages [ 5170.754183] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5170.762323] Lustre: Skipped 18 previous similar messages [ 5170.768708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.777496] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5170.781399] Lustre: Skipped 18 previous similar messages [ 5171.705443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.789603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.640760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.662841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.610651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.634433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.547142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.511728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.492255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.600821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.650862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.743716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.764650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.691832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.642531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.642789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.583438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.670279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.609779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.626070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.488894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.609456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.556735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.783054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.970434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.150991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.095928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.018406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.037300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.069515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5202.030283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.071466] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5203.075866] Lustre: Skipped 31 previous similar messages [ 5203.086664] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5203.094404] Lustre: Skipped 31 previous similar messages [ 5203.103060] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5203.107928] Lustre: Skipped 31 previous similar messages [ 5203.111204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.121425] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5203.135090] Lustre: Skipped 31 previous similar messages [ 5204.015836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.090952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.928523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.058828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.111198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.227119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.281935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.507464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.829313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5214.335141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.860898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.233655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.442970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.837495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.707032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.787602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.829850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.434374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.536759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.510935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.621948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.796624] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5227.810585] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5227.818933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.037048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.947906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.935665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.918533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.930479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.953828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.793880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.891317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.929209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.810730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.928181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.683411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.883544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.988775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.998508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.065745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.269102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.093384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.268854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.203171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.478800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.555392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.549228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.620259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.952570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.174451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.246535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.407274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.421936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.307376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.208582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.039592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.905895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.936694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5263.879380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.963864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.871369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.902429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.788832] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5267.796856] Lustre: Skipped 60 previous similar messages [ 5267.816069] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5267.827856] Lustre: Skipped 60 previous similar messages [ 5267.837958] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5267.842967] Lustre: Skipped 60 previous similar messages [ 5267.846940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.854559] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5267.865587] Lustre: Skipped 60 previous similar messages [ 5268.762762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.607163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.597740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.610270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.582638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.583200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.542415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.492854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.603047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.580635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.767686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.628308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.729917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.728976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.838071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.791437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.955764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.935434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.315753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.573601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.522601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5290.429482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5291.405199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.355230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.174421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.136923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.970664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.005606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.088063] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5297.099531] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5297.114860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.059588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.964469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.866469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5300.988518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5301.922443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.870079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.739804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.794520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.840195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5306.872159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5307.865265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.776256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.797385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5310.652044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.583352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.495785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.517387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.383114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.395520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.444835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5317.320618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5318.145283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.049061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.867717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5320.779394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.608910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.633984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.612248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.701777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.668985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.655478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.588626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.586129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5329.572141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.615198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.661226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.789660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.702060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.622194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.365848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.247717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.303968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5338.175497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.130250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.999292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.801047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.777799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.793094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.696740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.750806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.684919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.611267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.587539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5348.504592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.453169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.402497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.341762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5352.275180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.148212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.225957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.058627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.903968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.825423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.952576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5358.846512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.851520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.892965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5361.884956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.842761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.038408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.919776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.009061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.955074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.836186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.827928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.975962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.131807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.321851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.277270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.480198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.555507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.464229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.430900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5378.501921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.619602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5380.714944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.885923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.964886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.072294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.068436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5386.143547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.258488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5388.436674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.381950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.471618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.457093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5392.393992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5393.407721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5394.396972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.593321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.583200] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5396.590543] Lustre: Skipped 129 previous similar messages [ 5396.599777] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5396.615444] Lustre: Skipped 129 previous similar messages [ 5396.620163] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5396.630908] Lustre: Skipped 129 previous similar messages [ 5396.635614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.646231] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5396.652864] Lustre: Skipped 129 previous similar messages [ 5397.696559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.694207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.651842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.501613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.455777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5402.387120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5403.388844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5404.284039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.251560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.136968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.013404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.964102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.879677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.734618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5410.811157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.750516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.767779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5413.678569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.930145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.936557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.913077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.791517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5418.644888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.461849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.296936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5421.210035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.047193] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5422.057408] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5422.066852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.059221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.075829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.978699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.031806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.880152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.833279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.787619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.772387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.606649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.484881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.436089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.485728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.331448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.044353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.894952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.750309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.656017] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5438.475512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.265607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.108800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.978113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.931238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.671371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.397581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.240798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5445.382544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.537737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.438459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5448.592912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.370136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5450.287033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.154599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.096606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.867774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.889183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.300368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.532083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5457.773761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.817798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5459.700323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.540315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.344893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.303952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.155939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.172950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.968476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.050531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.956568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.582982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.580057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.741232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.854336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.895541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5473.255898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.526309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.665918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5476.484642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5477.388268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.112715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.989715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5479.794750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.522525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.462772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.336474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.429856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.502441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.385260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.322511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.392826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.172799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.937517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.824593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.831295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.816228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.834637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.779130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.711654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.687846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.659087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.649879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.447059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5499.611128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.714339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.734525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.921460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.875324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.787827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.776845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.731922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.793489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.722955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.625603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.615106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.592947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.622513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.555123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.430649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.503996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.541809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.395936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.444137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.324065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.328920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.258112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.176742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.044555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.993050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.834441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.704967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.616628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.665486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.580419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.353281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5530.263353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.223273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.155496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.249327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.107548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.014091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.908864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.972381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.895390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.983473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.990170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.954677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.925464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.758773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.590874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.562783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.650073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.678336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.835440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.901178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.846379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.812439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.816663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.789164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.647191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.424069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.366822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.379811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.492688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.294373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.375457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.464621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.457464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.423648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.425653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.467766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.332264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.302944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.152709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.299283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.298894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.242197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.173281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.140409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.078491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.111295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.139175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.038299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.095983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.093916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.082118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.062527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.067940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.007109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.874931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.997703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.005831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.752902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.667947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.730264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.598424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.578676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.463652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.317147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.164100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.132490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.994473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.007307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.061210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.015876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.997476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.977614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.002079] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5600.011904] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5600.022912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.903869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.915356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.856360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.849982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.884685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.820386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.739356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.717922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.554502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.371251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.369415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.260471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.158496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.066109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.088954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.086059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.954506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.975293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.968779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.065941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.082076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.993184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.931532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.832816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.804832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.849049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.696827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.570578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.580053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.585575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.412973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.260563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.346857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.279207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.188591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.240962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.339855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.502705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.493604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.686348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.718340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.828580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.751368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.808631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.810592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.825560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.829814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.968873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.031582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.244882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.274116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.214828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.331383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.382921] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5653.391655] Lustre: Skipped 266 previous similar messages [ 5653.405765] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5653.420360] Lustre: Skipped 266 previous similar messages [ 5653.423846] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5653.427826] Lustre: Skipped 266 previous similar messages [ 5653.430875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.440390] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5653.448482] Lustre: Skipped 266 previous similar messages [ 5654.622890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.651443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.589392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.520586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.717853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.729501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.807042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.670864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.755557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.696782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.649440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.728611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.954364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.004343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.120178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.152433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.276480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.183172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.467014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.574456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.565727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.829263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.061597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.104121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.094481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.253669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5682.452218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.540280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.785514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.726243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.947375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.959039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.089338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.171878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.307590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.538780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.485585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.775765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.783481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.850451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.794706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.816230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.915506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.014748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.082334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.275454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.404707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.278500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.204446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.222397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.057806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.992989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.746604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.548729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.433383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.283830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.351203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.272910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.275817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.193524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.065761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.067421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.022740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.072181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.163810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.095506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.060330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.047911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.922195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.933810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5726.844915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.881955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.861286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.807833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.745046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.822055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.743179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.688903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.799118] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5734.817933] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5734.819929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.723715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.868334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.807767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.735095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.639477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.753993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.669516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.834663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.795085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.670897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.598785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.600990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.552671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.587482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.528760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.505668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.416919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.547618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5753.474451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.549370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.426662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.274903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.257750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5758.095675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.172376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.164160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.094760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5762.033231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5762.986026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.089945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5765.021094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5766.032170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.193635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.146578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.267700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.158981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.038581] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5771.053243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.055756] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5772.031544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5773.036225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.112215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.991826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.902596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.821461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.650335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.651721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.478400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.461992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5781.362263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.183036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.276540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.218565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5785.134305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.241640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.491787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5788.739677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.131910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.116609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.153715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.360538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.615464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.047134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.486499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.346704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.325285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.508964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.569579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.517025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5803.592068] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5803.604929] LustreError: 170991:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5803.611880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.564979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.802462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.926507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.901066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.087618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.341873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.608448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.910957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.971352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.200719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.203498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.221877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.083827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.053539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.991415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.001414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.894487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.780434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.780344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.726110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.733255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.956884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.069239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5829.277948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.470496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.561793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5832.674142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.684875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.714899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.856712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.091168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5838.047768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.142692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5840.092374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.034690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.048278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.177639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.145980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.360659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.487092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.704270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.569547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.559428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.428498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5851.556876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.495425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.647129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.673292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5856.039431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.261452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5858.320731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.300175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.192614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.196392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.549992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5863.533802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.574568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5865.590097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.625132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5867.543916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.686098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.053817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5871.349633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.483457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.611370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.583217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.611363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5876.602822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.491943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5878.301908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.336315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5880.280081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.452879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.511809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5883.550596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5884.669729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.604826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.622271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.566623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5888.614637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.597454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.506702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.566096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.567311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5893.382695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.193247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.066042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.018261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.816981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5897.878058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.809984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.573887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5900.410735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.507153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.496099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5903.633527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.948692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.156744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.355259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5908.221095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.252277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.106020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5911.343731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5912.421277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.421859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.398097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5915.284414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5916.456961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5917.405063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.752788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5919.890343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.128595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.219872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.280169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.402632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.421321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5926.362239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.198788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.048889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.848505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.802485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5930.692550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.546106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5932.390758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.488570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.350027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.393105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5936.444525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.577315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.520994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.637482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.392492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.338062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.310396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.241645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.272382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.243573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5946.474248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.456331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.497861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5949.352967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.393869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5951.406448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.288445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.231592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.274502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5955.213637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.191591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5957.056455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.034853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.884657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.848460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5960.964726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.885513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.898914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.994393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.831153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.850087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.714448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5967.522832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.437911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.344388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.234479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.197252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.087787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.006294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.917579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5974.817276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.802536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.861558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.892317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.740064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.836093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.890374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.804707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.747189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.652376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.546460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5985.484042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.394605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.299744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.298609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.278392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.235432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.186063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.264193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.276737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.250183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5995.171511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.344612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5997.291157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.199767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5999.124104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.120449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.972069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.882911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6002.697772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.825166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.663948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6005.547592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.513829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.545363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6008.494451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.485740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.462443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.383554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.342942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.182312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6014.211264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.031565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.965963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.851240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.780483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6018.703600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.701548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.732415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.849526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.916683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6023.832253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.834386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.731576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.832661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.828188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.730051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.702778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6030.671758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.579927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.394334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.220479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.049826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.874536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.791950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.552122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.363420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6038.283044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.167691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6040.081945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.008194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.868904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.723056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.508237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.322476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6045.186169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.175570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.192155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.141645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.197420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.109613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.975075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.862705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6052.849701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6053.779408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.722591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.784705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.792436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.809335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.784631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.726756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.634757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.679919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.470638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.306743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6064.157411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.140988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.152414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.260791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.084208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.239673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.507543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.642557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.558566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6073.474810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.351030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6075.482318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6076.884668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.076622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6079.321359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.707493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.842460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.302419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.563461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.568113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6086.797761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.269067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6089.615633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.576831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.767858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.923220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.861727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.762081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6095.897312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.960852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.100370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6099.094214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.307826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.289215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.386058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.361965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6104.317078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.264646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.216408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.321889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.502085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.586944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.638721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.670844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.631914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6113.650470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.570126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.620532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6116.476984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.449796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.296226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.242220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.230641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.411187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.434239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.470849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6124.468192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.522358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.607241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.499898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6128.755933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.704261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6557.018809] LustreError: 172791:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6557.041807] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6557.058143] LustreError: 170991:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 1 previous similar message [ 7277.033840] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7277.053901] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7277.068066] Lustre: Skipped 471 previous similar messages [ 7277.080750] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7278.070946] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 7278.073142] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7278.077634] LustreError: Skipped 4 previous similar messages [ 7278.790027] Lustre: server umount lustre-OST0000 complete [ 7285.221819] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7289.001882] Lustre: server umount lustre-MDT0000 complete [ 7290.338919] LustreError: 170972:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7290.352655] LustreError: 170972:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7292.560157] LustreError: 170952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782224779 with bad export cookie 1970186533988940522 [ 7292.567019] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7292.574231] LustreError: 170952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7292.867474] Lustre: server umount lustre-MDT0001 complete [ 7302.931438] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 7305.385986] Key type lgssc unregistered [ 7305.696571] LNet: 226261:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7305.707599] LNetError: 226261:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7305.730565] LNet: Removed LNI 192.168.203.158@tcp [ 7306.634309] Key type .llcrypt unregistered [ 7306.636412] Key type ._llcrypt unregistered [ 7333.588407] Key type ._llcrypt registered [ 7333.590753] Key type .llcrypt registered [ 7333.709271] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 7334.734651] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7334.749378] alg: No test for adler32 (adler32-zlib) [ 7335.727573] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 7335.932271] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 7337.648186] Key type lgssc registered [ 7338.745662] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7346.780247] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7346.815499] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7348.672683] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7353.404355] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7358.949813] LustreError: 227678:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7358.974455] LustreError: 227678:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7362.606597] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7363.177070] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7368.308689] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7375.208873] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7381.448267] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7389.263691] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7389.655902] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7393.789991] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 7396.689071] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7405.550993] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7413.859837] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 7415.923813] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7415.935041] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 7415.951662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7415.968760] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7415.970312] LustreError: 227698:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 7422.882083] Lustre: lustre-OST0000: Not available for connect from 192.168.203.58@tcp (stopping) [ 7423.469431] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7423.472904] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7423.485757] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7423.506638] Lustre: Skipped 1 previous similar message [ 7424.742628] Lustre: server umount lustre-OST0000 complete [ 7436.056171] LustreError: 227698:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 7459.604956] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7460.105040] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7463.222554] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7463.232919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7463.233299] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 7463.257566] Lustre: Skipped 1 previous similar message [ 7466.152413] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7474.403588] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7476.105509] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 7481.935483] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9062d131f800.ost_server_uuid 50 [ 7483.459642] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9062d131f800.ost_server_uuid in FULL state after 0 sec [ 7488.996923] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7488.998202] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7489.012173] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7489.012185] Lustre: Skipped 1 previous similar message [ 7489.056064] Lustre: Skipped 1 previous similar message [ 7494.116743] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7494.123302] Lustre: Skipped 2 previous similar messages [ 7494.837311] Lustre: server umount lustre-OST0000 complete [ 7501.284256] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7501.316313] LustreError: Skipped 1 previous similar message [ 7501.323702] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7501.343263] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7505.784376] Lustre: server umount lustre-MDT0000 complete [ 7509.474982] LustreError: 227679:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7509.507308] LustreError: 227679:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7510.385373] LustreError: 229520:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782224997 with bad export cookie 2386567037417249744 [ 7510.400839] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7510.408399] LustreError: 229520:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7511.017022] Lustre: server umount lustre-MDT0001 complete [ 7524.379752] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 7527.490963] Key type lgssc unregistered [ 7527.796968] LNet: 232894:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7527.814405] LNetError: 232894:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7527.829592] LNet: Removed LNI 192.168.203.158@tcp [ 7528.717112] Key type .llcrypt unregistered [ 7528.720270] Key type ._llcrypt unregistered [ 7563.229729] Key type ._llcrypt registered [ 7563.233629] Key type .llcrypt registered [ 7563.406935] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 7564.920768] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7565.032060] alg: No test for adler32 (adler32-zlib) [ 7566.153904] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 7566.442854] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 7568.120532] Key type lgssc registered [ 7569.443365] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7579.734569] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7579.773669] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7581.255798] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7585.345481] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7591.403732] LustreError: 234622:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7591.422836] LustreError: 234622:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7594.449720] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7594.974670] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7600.036838] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7603.358484] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7610.558993] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7611.003465] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7617.838510] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7626.370797] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 7627.862272] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7628.158927] Lustre: lustre-OST0001: new disk, initializing [ 7628.168230] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7628.190038] Lustre: 236931:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7628.361267] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7636.220435] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7636.703542] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7636.715446] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7636.873658] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7648.827474] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7655.804513] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7671.780936] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7671.791216] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7671.817270] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7672.811745] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7672.816977] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7672.823822] Lustre: Skipped 1 previous similar message [ 7672.844575] Lustre: Skipped 2 previous similar messages [ 7676.500877] Lustre: server umount lustre-MDT0000 complete [ 7677.921195] LustreError: 235885:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7677.941791] LustreError: 235885:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7680.342037] LustreError: 234604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225167 with bad export cookie 18400957044900550926 [ 7680.353856] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7680.355478] LustreError: 234604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7680.826845] Lustre: server umount lustre-MDT0001 complete [ 7695.191108] Lustre: server umount lustre-OST0000 complete [ 7708.929471] Lustre: server umount lustre-OST0001 complete [ 7732.763468] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 7744.752758] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7745.637106] LustreError: 240042:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7745.744344] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7751.158945] LustreError: 240043:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7752.088656] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7755.234709] LustreError: 240042:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7763.641557] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7764.194925] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7768.933937] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7772.032338] Lustre: 241187:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7780.883567] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7781.221716] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7789.424508] LustreError: 241540:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7789.471778] LustreError: 241540:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7790.511506] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49760) [ 7792.105443] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7800.958748] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7806.488185] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7808.426248] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7817.428590] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7821.703089] Lustre: 243058:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7836.129832] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7836.139292] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7836.149755] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7836.152331] Lustre: Skipped 2 previous similar messages [ 7838.872789] Lustre: server umount mylustre-MDT0000 complete [ 7842.274688] LustreError: 240043:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7842.287159] LustreError: 240043:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 7842.714477] LustreError: 240018:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225329 with bad export cookie 18400957044900553733 [ 7842.724826] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7842.738777] LustreError: 240018:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7843.065969] Lustre: server umount mylustre-MDT0001 complete [ 7857.796855] Lustre: server umount mylustre-OST0000 complete [ 7871.922534] Lustre: server umount mylustre-OST0001 complete [ 7894.611520] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 7905.207336] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7905.701800] LustreError: 245369:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7905.780697] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7905.791941] Lustre: Skipped 1 previous similar message [ 7910.804220] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7920.656399] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7926.024065] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7929.160618] Lustre: 246511:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7936.666703] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7946.386370] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7951.861716] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49792) [ 7955.975295] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7961.592370] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 7962.732928] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 7970.132150] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7973.716525] Lustre: 248379:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7982.059857] Lustre: tfs-MDT0000-lwp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7982.073201] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7982.081944] Lustre: Skipped 5 previous similar messages [ 7982.106357] Lustre: Skipped 7 previous similar messages [ 7982.938863] Lustre: server umount tfs-MDT0000 complete [ 7986.733864] LustreError: 248381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225473 with bad export cookie 18400957044900555623 [ 7986.735402] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7986.745612] LustreError: 248381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7987.213379] Lustre: server umount tfs-MDT0001 complete [ 8001.592723] Lustre: server umount tfs-OST0000 complete [ 8003.555056] Lustre: 233885:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782225474/real 1782225474] req@ffff93495cc58380 x1868798417383936/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782225490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8003.588251] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8003.607042] Lustre: Skipped 1 previous similar message [ 8005.171512] Lustre: server umount tfs-OST0001 complete [ 8025.454459] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8038.892417] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8039.518140] LustreError: 250629:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8039.540192] LustreError: 250629:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 8039.618281] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8039.629630] Lustre: Skipped 3 previous similar messages [ 8043.894221] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8053.197336] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8058.607892] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8061.998860] Lustre: 251772:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8069.225566] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8076.309991] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8085.195547] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8086.453848] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49824) [ 8086.464737] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 8091.834764] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8099.024771] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8102.520093] Lustre: 253643:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8109.042920] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 10:39:55 (1782225595) [ 8125.413636] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8125.422368] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8125.437636] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8131.389781] Lustre: server umount lustre-MDT0000 complete [ 8135.195153] LustreError: 251373:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225622 with bad export cookie 18400957044900557289 [ 8135.201525] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8135.208436] LustreError: 251373:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8137.703711] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8137.710878] Lustre: Skipped 5 previous similar messages [ 8141.673962] Lustre: server umount lustre-MDT0001 complete [ 8151.485658] Lustre: server umount lustre-OST0000 complete [ 8160.943767] Lustre: server umount lustre-OST0001 complete [ 8167.245423] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 8178.479614] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8214.916126] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 8214.916126] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 8214.916126] [ 8214.936708] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 8215.259861] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8215.320455] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8215.384208] Lustre: lustre-MDT0000: new disk, initializing [ 8215.573524] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8215.582076] Lustre: Skipped 3 previous similar messages [ 8215.602679] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8219.953834] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8231.225669] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 8231.225669] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 8231.225669] [ 8231.253520] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 8231.402777] Lustre: 256826:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8231.467602] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8231.474989] Lustre: Skipped 1 previous similar message [ 8231.621947] Lustre: lustre-MDT0001: new disk, initializing [ 8231.727909] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8231.739049] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8235.858368] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8246.271206] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8246.630375] Lustre: lustre-OST0000: new disk, initializing [ 8246.634440] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8246.639731] Lustre: 258409:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8248.021534] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8248.035907] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8248.127602] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8253.598819] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8263.886091] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8264.026730] Lustre: lustre-OST0001: new disk, initializing [ 8264.030906] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8264.042166] Lustre: 259281:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8265.295591] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8265.301778] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8265.418289] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8269.933420] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8279.672902] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 10:42:46 (1782225766) [ 8292.965653] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 10:42:59 (1782225779) [ 8309.732686] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8309.735499] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8309.749968] LustreError: Skipped 1 previous similar message [ 8309.756281] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8309.760888] Lustre: Skipped 6 previous similar messages [ 8309.777591] Lustre: Skipped 3 previous similar messages [ 8314.013473] Lustre: server umount lustre-OST0000 complete [ 8316.899959] LustreError: 258393:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8316.917317] LustreError: 258393:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 13 previous similar messages [ 8318.947619] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8323.976772] Lustre: server umount lustre-MDT0000 complete [ 8327.867854] LustreError: 256819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225814 with bad export cookie 18400957044900558843 [ 8327.870075] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8327.875939] LustreError: 256819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8334.281316] Lustre: server umount lustre-MDT0001 complete [ 8345.044512] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 8362.545910] Lustre: server umount lustre-OST0001 complete [ 8369.494684] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 8386.815750] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8420.586180] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8420.823509] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8420.865225] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8420.972780] Lustre: lustre-MDT0000: new disk, initializing [ 8421.069296] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8425.793910] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8435.862989] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8435.970429] Lustre: 263837:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8436.223396] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8440.644516] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8450.244678] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8454.389171] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8461.697330] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8462.022794] Lustre: lustre-OST0000: new disk, initializing [ 8462.024925] Lustre: Skipped 1 previous similar message [ 8462.027583] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8462.034413] Lustre: Skipped 2 previous similar messages [ 8462.039433] Lustre: 265804:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8463.957622] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8463.969953] Lustre: Skipped 1 previous similar message [ 8463.982442] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8464.086133] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8467.760156] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8476.566453] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8484.836146] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8484.839902] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8484.850329] LustreError: Skipped 1 previous similar message [ 8484.866490] Lustre: Skipped 4 previous similar messages [ 8484.872646] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8484.887712] Lustre: Skipped 8 previous similar messages [ 8489.604919] Lustre: server umount lustre-OST0000 complete [ 8507.360241] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8507.588624] Lustre: server umount lustre-MDT0000 complete [ 8511.426807] LustreError: 263827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782225998 with bad export cookie 18400957044900560313 [ 8511.430094] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8511.434511] LustreError: 263827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8511.767186] Lustre: server umount lustre-MDT0001 complete [ 8521.422310] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 8523.932185] Key type lgssc unregistered [ 8524.197594] LNet: 267565:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8524.203955] LNetError: 267565:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8525.231162] LNet: Removed LNI 192.168.203.158@tcp [ 8526.152169] Key type .llcrypt unregistered [ 8526.155928] Key type ._llcrypt unregistered [ 8551.667922] Key type ._llcrypt registered [ 8551.670760] Key type .llcrypt registered [ 8551.830419] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8552.817930] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8552.840964] alg: No test for adler32 (adler32-zlib) [ 8554.137982] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 8554.319635] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 8555.960378] Key type lgssc registered [ 8557.389118] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8565.876545] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8565.890242] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8567.543216] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8572.741917] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8578.020341] LustreError: 269030:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8578.049042] LustreError: 269030:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8582.130642] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8582.436343] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8586.417868] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8593.906581] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8600.474800] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8607.820383] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8608.256838] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8613.407085] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 8615.216600] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8622.860481] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8623.806634] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 8627.695310] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8627.700436] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8632.000287] Lustre: server umount lustre-OST0000 complete [ 8637.922666] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8637.951953] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8637.954193] Lustre: Skipped 1 previous similar message [ 8637.981090] Lustre: Skipped 2 previous similar messages [ 8642.848569] Lustre: server umount lustre-MDT0000 complete [ 8643.045218] LustreError: 271373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8643.067128] LustreError: 271373:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8646.455131] LustreError: 271559:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226133 with bad export cookie 7520333395128980891 [ 8646.462504] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8646.463084] LustreError: 271559:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8646.700171] Lustre: server umount lustre-MDT0001 complete [ 8656.768636] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 8659.670772] Key type lgssc unregistered [ 8659.927472] LNet: 272613:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8659.933095] LNetError: 272613:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8659.944973] LNet: Removed LNI 192.168.203.158@tcp [ 8660.683551] Key type .llcrypt unregistered [ 8660.686930] Key type ._llcrypt unregistered [ 8676.291791] Key type ._llcrypt registered [ 8676.295916] Key type .llcrypt registered [ 8676.389884] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8677.538054] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8677.572056] alg: No test for adler32 (adler32-zlib) [ 8678.630427] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 8678.841788] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 8680.496175] Key type lgssc registered [ 8681.413529] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8689.527240] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8689.546554] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8705.124294] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 8710.240308] LustreError: 273805:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.158@tcp: failed processing log, type 4: rc = -110 [ 8736.929885] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8742.338268] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 8748.502155] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8750.369314] Lustre: server umount lustre-OST0000 complete [ 8766.134429] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 8768.808821] Key type lgssc unregistered [ 8769.116500] LNet: 275438:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8769.122655] LNetError: 275438:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8769.142838] LNet: Removed LNI 192.168.203.158@tcp [ 8769.873087] Key type .llcrypt unregistered [ 8769.880708] Key type ._llcrypt unregistered [ 8807.697264] Key type ._llcrypt registered [ 8807.699786] Key type .llcrypt registered [ 8807.912841] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8809.741392] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8809.789385] alg: No test for adler32 (adler32-zlib) [ 8810.938660] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 8811.217304] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 8812.896668] Key type lgssc registered [ 8813.882450] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8825.402320] loop0: detected capacity change from 0 to 204800000 [ 8825.579874] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8825.598327] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8825.920230] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8826.920739] loop0: detected capacity change from 0 to 204800000 [ 8827.138969] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8827.149978] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8827.646255] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8828.726408] loop0: detected capacity change from 0 to 204800000 [ 8828.988512] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8829.013075] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8829.157131] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8830.630440] loop0: detected capacity change from 0 to 204800000 [ 8830.813923] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8830.830615] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8830.955732] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8831.974213] loop0: detected capacity change from 0 to 204800000 [ 8832.026190] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8836.531902] loop0: detected capacity change from 0 to 204800000 [ 8836.553074] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8840.521140] loop0: detected capacity change from 0 to 204800000 [ 8840.545847] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8844.497556] loop0: detected capacity change from 0 to 204800000 [ 8844.541900] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8847.954754] loop0: detected capacity change from 0 to 204800000 [ 8848.051500] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8848.094450] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8848.218381] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8848.237883] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 8848.257094] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8848.277610] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8848.294409] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 8848.310982] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 8848.336322] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8848.357262] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 8848.377596] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8848.402143] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 8848.419596] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 8848.438230] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 8848.450287] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 8848.477233] Lustre: 278852:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 8853.839286] Lustre: server umount MGS complete [ 8854.620696] loop0: detected capacity change from 0 to 204800000 [ 8854.731667] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8855.337876] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8855.385785] Lustre: lustre-MDT0000: Aborting client recovery [ 8856.303440] loop1: detected capacity change from 0 to 204800000 [ 8856.439400] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8856.577625] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8856.596105] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8856.610216] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8856.632456] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8856.650382] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8856.672647] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8856.688215] Lustre: 279284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8856.725481] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8856.951048] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8857.004369] Lustre: lustre-MDT0001: Aborting client recovery [ 8857.877115] loop2: detected capacity change from 0 to 204800000 [ 8858.097316] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8858.171169] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8858.193361] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8858.204324] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8858.216170] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8858.227170] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8858.245505] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8858.260993] Lustre: 279364:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8858.409128] Lustre: Found index 0 for lustre-OST0000, updating log [ 8858.459928] Lustre: 279383:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8858.528555] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8858.552816] Lustre: lustre-OST0000: Aborting recovery [ 8859.477061] loop3: detected capacity change from 0 to 204800000 [ 8859.637313] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8859.740969] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8859.761757] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8859.788167] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8859.819814] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8859.832522] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8859.842515] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8859.860844] Lustre: 279449:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8859.890461] Lustre: Found index 1 for lustre-OST0001, updating log [ 8859.922229] Lustre: 279455:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8860.056177] Lustre: lustre-OST0001: Aborting recovery [ 8865.129167] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8865.138611] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8865.155102] LustreError: 279228:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 8865.177638] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8865.207886] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8866.152141] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8866.154144] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8869.502944] LustreError: 279195:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 2158us: rc = -2 [ 8870.007954] LustreError: 279194:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 459us: rc = -2 [ 8870.031416] LustreError: 279194:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 23 previous similar messages [ 8886.757402] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8886.758899] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8886.778328] Lustre: Skipped 3 previous similar messages [ 8886.795837] Lustre: Skipped 3 previous similar messages [ 8889.203725] Lustre: server umount lustre-MDT0000 complete [ 8890.221325] LustreError: 279178:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226377 with bad export cookie 4249380896640122922 [ 8890.232451] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8891.876758] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8891.877176] LustreError: 279391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8891.882144] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8891.911612] Lustre: Skipped 1 previous similar message [ 8891.933487] LustreError: 279391:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8895.909431] LustreError: 279192:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8895.922233] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8895.935285] LustreError: 279192:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8895.941195] Lustre: Skipped 2 previous similar messages [ 8896.613668] Lustre: server umount lustre-MDT0001 complete [ 8903.581253] Lustre: server umount lustre-OST0000 complete [ 8910.831241] Lustre: server umount lustre-OST0001 complete [ 8919.326812] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 10:53:25 (1782226405) [ 8948.590982] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 8958.551038] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 8995.037578] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8995.320193] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8995.366326] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8995.447760] Lustre: lustre-MDT0000: new disk, initializing [ 8995.580374] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8995.592381] Lustre: Skipped 1 previous similar message [ 8995.614493] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9000.065813] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9011.127841] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9011.259728] Lustre: 283530:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9011.316860] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9011.321622] Lustre: Skipped 1 previous similar message [ 9011.436957] Lustre: lustre-MDT0001: new disk, initializing [ 9011.565453] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9011.609418] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9011.626282] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9016.456344] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9026.561531] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9032.257316] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9041.066682] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9041.370137] Lustre: lustre-OST0000: new disk, initializing [ 9041.379677] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9041.386980] Lustre: 285498:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9041.513466] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9049.269892] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9050.716769] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9050.728973] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9050.904825] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9059.560939] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9065.540180] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9077.840938] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9086.104748] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9138.145682] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9138.150543] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9138.156276] LustreError: Skipped 1 previous similar message [ 9138.162048] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9138.176612] Lustre: Skipped 1 previous similar message [ 9138.188592] Lustre: Skipped 1 previous similar message [ 9143.270039] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9143.281444] Lustre: Skipped 1 previous similar message [ 9143.798672] Lustre: server umount lustre-OST0000 complete [ 9148.387194] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9153.508745] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9153.515278] Lustre: Skipped 3 previous similar messages [ 9154.053513] Lustre: server umount lustre-MDT0000 complete [ 9158.051379] LustreError: 283521:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226645 with bad export cookie 4249380896640125638 [ 9158.063290] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9158.064675] LustreError: 283521:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 9158.572363] Lustre: server umount lustre-MDT0001 complete [ 9167.807816] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9172.891836] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9178.332691] Lustre: server umount MGS complete [ 9191.469868] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9191.938053] LustreError: 289419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9191.958684] LustreError: 289432:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9192.015049] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9196.869986] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9197.027347] LustreError: 289420:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9197.062302] LustreError: 289420:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9201.125818] LustreError: 289419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9206.665476] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9211.018866] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9220.636976] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9227.223371] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9236.012365] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9236.225958] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9236.233308] Lustre: Skipped 1 previous similar message [ 9242.639418] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9250.155983] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9288.698070] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9288.703973] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9288.704449] LustreError: Skipped 1 previous similar message [ 9288.707467] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9288.732013] Lustre: Skipped 2 previous similar messages [ 9292.155419] Lustre: server umount lustre-OST0000 complete [ 9298.925623] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9298.941390] Lustre: Skipped 1 previous similar message [ 9302.542912] Lustre: server umount lustre-MDT0000 complete [ 9304.036100] LustreError: 289419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9304.061881] LustreError: 289419:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9307.238376] LustreError: 292144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782226794 with bad export cookie 4249380896640127493 [ 9307.247392] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9307.261325] LustreError: 292144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9307.816996] Lustre: server umount lustre-MDT0001 complete [ 9320.139130] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 9322.839783] Key type lgssc unregistered [ 9323.138806] LNet: 293368:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9323.158469] LNetError: 293368:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9323.180836] LNet: Removed LNI 192.168.203.158@tcp [ 9324.088921] Key type .llcrypt unregistered [ 9324.091538] Key type ._llcrypt unregistered [ 9361.569416] Key type ._llcrypt registered [ 9361.571696] Key type .llcrypt registered [ 9361.707647] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 9377.554257] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 9379.454467] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9379.494913] alg: No test for adler32 (adler32-zlib) [ 9380.587246] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 9380.936811] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 9382.634052] Key type lgssc registered [ 9384.022742] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9420.924495] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9420.969991] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9422.263385] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9422.306734] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9422.410537] Lustre: lustre-MDT0000: new disk, initializing [ 9422.499929] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9422.515589] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9427.417590] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9438.385151] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9438.498307] Lustre: 297339:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9438.540565] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9438.550946] Lustre: Skipped 1 previous similar message [ 9438.651257] Lustre: lustre-MDT0001: new disk, initializing [ 9438.771060] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9438.825321] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9438.848551] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9443.513468] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9453.019257] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9459.699331] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9466.994141] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9467.405916] Lustre: lustre-OST0000: new disk, initializing [ 9467.410339] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9467.418327] Lustre: 299308:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9467.516563] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9473.099864] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9473.112972] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9473.234926] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9473.783711] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9483.090860] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9490.137215] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9502.729412] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9511.800383] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9517.431894] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 9570.790623] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9570.793216] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9570.795830] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9570.798535] LustreError: Skipped 1 previous similar message [ 9570.811497] Lustre: Skipped 1 previous similar message [ 9573.571546] Lustre: server umount lustre-OST0000 complete [ 9581.029790] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9581.031141] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9581.056510] Lustre: Skipped 1 previous similar message [ 9581.060882] Lustre: Skipped 1 previous similar message [ 9583.524548] Lustre: server umount lustre-MDT0000 complete [ 9587.419276] LustreError: 299307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227074 with bad export cookie 7327856810761345821 [ 9587.428914] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9587.429655] LustreError: 299307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9587.952702] Lustre: server umount lustre-MDT0001 complete [ 9595.867676] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9600.983819] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9606.875727] Lustre: server umount MGS complete [ 9619.707826] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9620.338874] LustreError: 303322:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9620.357446] LustreError: 303322:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9620.400816] LustreError: 303335:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9620.481497] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9625.237718] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9625.570497] LustreError: 303323:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9630.694628] LustreError: 303322:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9635.055423] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9635.340935] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9640.596698] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9648.268810] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9654.285339] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9661.356389] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9661.672697] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9668.833962] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9677.705660] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9712.100991] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9712.113340] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9712.127054] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9712.135193] Lustre: Skipped 1 previous similar message [ 9716.202382] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9716.204814] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9716.212628] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9717.772715] Lustre: server umount lustre-OST0000 complete [ 9722.337475] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9722.345218] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9722.377124] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9722.388287] Lustre: Skipped 1 previous similar message [ 9731.556098] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9731.571375] Lustre: Skipped 3 previous similar messages [ 9736.160441] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9736.364508] Lustre: server umount lustre-MDT0000 complete [ 9736.673888] LustreError: 305612:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9736.694613] LustreError: 305612:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9741.008567] LustreError: 303303:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782227228 with bad export cookie 7327856810761347760 [ 9741.017284] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9741.030939] LustreError: 303303:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9741.634484] Lustre: server umount lustre-MDT0001 complete [ 9755.502901] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [ 9758.803506] Key type lgssc unregistered [ 9759.146894] LNet: 307272:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9759.169218] LNetError: 307272:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9759.198342] LNet: Removed LNI 192.168.203.158@tcp [ 9760.339881] Key type .llcrypt unregistered [ 9760.350097] Key type ._llcrypt unregistered [ 9784.611128] Key type ._llcrypt registered [ 9784.612912] Key type .llcrypt registered [ 9784.720367] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [ 9798.702025] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 9799.703943] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9799.760479] alg: No test for adler32 (adler32-zlib) [ 9800.982638] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [ 9801.307717] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [ 9803.024166] Key type lgssc registered [ 9804.412367] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9828.809692] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [ 9845.483852] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9845.536155] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9846.930750] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9846.970197] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9847.133494] Lustre: lustre-MDT0000: new disk, initializing [ 9847.295508] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9847.356180] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9852.544667] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9863.004480] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9863.300766] Lustre: lustre-OST0000: new disk, initializing [ 9863.306181] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9863.308951] Lustre: Skipped 1 previous similar message [ 9863.312889] Lustre: 311321:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9863.384942] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9869.364538] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [ 9871.944573] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 9871.962664] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 9872.003094] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [10808.428720] Lustre: server umount lustre-MDT0000 complete [10813.252808] LustreError: 310509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228300 with bad export cookie 14219170610002037720 [10813.284289] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10823.804211] Lustre: server umount lustre-OST0000 complete [10855.137703] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [10867.534394] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [10906.207556] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10906.516920] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10906.602585] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10906.728672] Lustre: lustre-MDT0000: new disk, initializing [10906.884356] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10906.928069] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10912.672303] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [10925.296610] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10925.469893] Lustre: 315685:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10925.574968] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10925.584410] Lustre: Skipped 1 previous similar message [10925.720793] Lustre: lustre-MDT0001: new disk, initializing [10925.846768] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10925.922323] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10925.956204] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10931.420318] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [10942.678429] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10948.476765] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10957.112207] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10957.572135] Lustre: lustre-OST0000: new disk, initializing [10957.575329] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10957.581445] Lustre: 317654:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10957.690552] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10965.132989] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [10966.627183] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10966.635920] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10966.812985] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10976.474317] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10982.408372] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10982.652992] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10988.095468] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10988.419838] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10992.611229] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10992.612855] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10992.628155] LustreError: Skipped 1 previous similar message [10992.643679] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10992.651571] Lustre: Skipped 1 previous similar message [10992.678378] Lustre: Skipped 1 previous similar message [10997.017573] Lustre: server umount lustre-OST0000 complete [11002.856918] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11002.862744] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11002.867935] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11002.870980] Lustre: Skipped 1 previous similar message [11002.888983] Lustre: Skipped 1 previous similar message [11007.523997] Lustre: server umount lustre-MDT0000 complete [11007.971761] LustreError: 316730:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11007.997021] LustreError: 316730:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11011.515345] LustreError: 315677:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228498 with bad export cookie 14219170610004978539 [11011.517979] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11011.528047] LustreError: 315677:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [11011.980820] Lustre: server umount lustre-MDT0001 complete [11015.640225] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [11018.071589] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 11:28:23 (1782228503) [11026.062505] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11026.775739] LustreError: 319969:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11026.844200] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11032.042835] LustreError: 319968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11032.516514] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11036.132424] LustreError: 319969:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11041.262655] LustreError: 319968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11043.205165] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11043.741749] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11049.371541] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11058.834932] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11065.525904] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11073.877382] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11074.469862] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11081.544139] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11090.449434] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11098.305131] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11098.480942] Lustre: lustre-OST0001: new disk, initializing [11098.485452] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [11098.491595] Lustre: 322803:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11098.591173] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11105.444492] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [11105.452258] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [11105.501288] LustreError: 323115:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11106.018390] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11106.538396] LustreError: 323115:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11106.562132] LustreError: 323115:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [11107.624893] LustreError: 323115:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11107.637616] LustreError: 323115:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [11109.678719] LustreError: 323123:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11109.693852] LustreError: 323123:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [11113.833790] LustreError: 323123:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11113.870940] LustreError: 323123:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 8 previous similar messages [11117.041140] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11117.342115] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11122.123532] LustreError: 323123:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11122.146850] LustreError: 323123:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [11123.390338] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9062c6a6c000.ost_server_uuid 50 [11124.975563] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9062c6a6c000.ost_server_uuid in FULL state after 0 sec [11131.502859] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9062c6a6c000.ost_server_uuid 50 [11133.042070] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9062c6a6c000.ost_server_uuid in FULL state after 0 sec [11135.488334] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [11149.793861] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11149.803973] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11149.841963] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11151.874557] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11151.883813] Lustre: Skipped 2 previous similar messages [11154.836068] Lustre: server umount lustre-OST0001 complete [11156.976107] LustreError: 321792:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11157.002171] LustreError: 321792:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [11162.092761] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11162.096992] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11162.106770] Lustre: Skipped 2 previous similar messages [11162.113942] Lustre: Skipped 1 previous similar message [11166.954239] Lustre: server umount lustre-OST0000 complete [11171.809974] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11171.819639] LustreError: Skipped 1 previous similar message [11171.824528] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11171.838924] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11171.845474] Lustre: Skipped 1 previous similar message [11177.123560] Lustre: server umount lustre-MDT0000 complete [11177.446251] LustreError: 319963:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11177.468193] LustreError: 319963:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [11181.367565] LustreError: 319950:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228668 with bad export cookie 14219170610004979421 [11181.369961] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11181.397212] LustreError: 319950:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [11181.803372] Lustre: server umount lustre-MDT0001 complete [11193.643427] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [11196.707175] Key type lgssc unregistered [11197.084592] LNet: 325497:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11197.093225] LNetError: 325497:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [11197.134728] LNet: Removed LNI 192.168.203.158@tcp [11198.186568] Key type .llcrypt unregistered [11198.190423] Key type ._llcrypt unregistered [11224.964314] Key type ._llcrypt registered [11224.966633] Key type .llcrypt registered [11225.111691] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [11226.476664] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11226.541847] alg: No test for adler32 (adler32-zlib) [11227.655814] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [11227.978972] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [11229.664193] Key type lgssc registered [11230.766718] Lustre: Echo OBD driver; http://www.lustre.org/ [11239.282856] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11239.320372] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11240.900206] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11245.950957] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11250.150433] LustreError: 326918:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11250.181328] LustreError: 326918:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11254.162413] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11255.271516] LustreError: 326919:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11260.392688] LustreError: 326918:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11261.110507] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11261.506638] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11266.593456] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11276.033515] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11276.473793] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11283.063676] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11285.675388] LustreError: 328599:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11285.701766] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [11291.838497] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11292.135871] LustreError: 328599:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11292.170846] LustreError: 328599:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11299.406566] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11299.652646] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11304.960412] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [11305.977139] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11313.767385] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [11321.623320] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [11321.865451] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11432.930148] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11432.944951] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11432.948301] LustreError: Skipped 1 previous similar message [11432.948891] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11432.983942] Lustre: Skipped 1 previous similar message [11438.063406] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11438.075310] Lustre: Skipped 2 previous similar messages [11443.168186] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11443.189323] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11443.208301] Lustre: Skipped 1 previous similar message [11443.409367] Lustre: server umount lustre-OST0001 complete [11448.291522] LustreError: 329074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11448.345730] LustreError: 329074:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11453.412618] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11453.425600] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11453.436043] Lustre: Skipped 1 previous similar message [11458.418671] Lustre: server umount lustre-OST0000 complete [11463.651277] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11463.684372] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11463.691734] Lustre: Skipped 2 previous similar messages [11469.516674] Lustre: server umount lustre-MDT0000 complete [11473.153976] LustreError: 326899:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782228960 with bad export cookie 8457932031523755671 [11473.166715] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11473.174349] LustreError: 326899:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [11473.471628] Lustre: server umount lustre-MDT0001 complete [11484.792189] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [11488.195590] Key type lgssc unregistered [11488.494522] LNet: 331866:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11488.509901] LNetError: 331866:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [11488.535147] LNet: Removed LNI 192.168.203.158@tcp [11489.576817] Key type .llcrypt unregistered [11489.581699] Key type ._llcrypt unregistered [11536.304532] Key type ._llcrypt registered [11536.306913] Key type .llcrypt registered [11536.451690] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [11537.530860] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11537.732229] alg: No test for adler32 (adler32-zlib) [11538.894372] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [11539.106544] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [11540.752164] Key type lgssc registered [11541.940543] Lustre: Echo OBD driver; http://www.lustre.org/ [11551.323367] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11551.351175] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11552.785058] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11556.771546] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11562.984050] LustreError: 334158:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11562.999297] LustreError: 334158:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11565.375228] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11565.717654] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11569.586504] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11572.489715] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [11578.748365] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11579.083421] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11585.303720] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11590.385967] LustreError: 335644:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11594.631199] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11594.817505] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11597.875243] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [11597.888610] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [11600.476898] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11609.533311] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11621.529293] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [11642.337753] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11642.349102] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11642.376300] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11643.875392] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11643.876083] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11643.884692] Lustre: Skipped 1 previous similar message [11643.903664] Lustre: Skipped 3 previous similar messages [11645.482343] Lustre: server umount lustre-MDT0000 complete [11649.025259] LustreError: 334155:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11649.059115] LustreError: 334155:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11649.863143] LustreError: 334137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229136 with bad export cookie 11027965262370685896 [11649.882206] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11650.229742] Lustre: server umount lustre-MDT0001 complete [11665.476444] Lustre: server umount lustre-OST0000 complete [11680.178839] Lustre: server umount lustre-OST0001 complete [11697.817690] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [11709.352816] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11709.646560] LustreError: 339421:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11709.705137] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11715.043727] LustreError: 339422:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11715.599616] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11724.258366] LustreError: 339421:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11724.285337] LustreError: 339421:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [11725.040244] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11725.587389] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11730.165246] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11733.492476] Lustre: 340562:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [11740.806861] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11748.465825] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11750.321165] LustreError: 341365:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11754.429993] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [11758.932597] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11759.378426] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11759.386169] Lustre: Skipped 1 previous similar message [11764.765337] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [11765.885084] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [11774.630154] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11778.473820] Lustre: 342436:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [11785.188734] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11785.190173] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11785.202051] Lustre: Skipped 4 previous similar messages [11785.204748] Lustre: Skipped 2 previous similar messages [11789.313930] Lustre: server umount lustre-MDT0000 complete [11790.311155] LustreError: 340938:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11790.339028] LustreError: 340938:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [11794.242987] LustreError: 339402:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229281 with bad export cookie 11027965262370687604 [11794.252052] LustreError: 339402:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11794.259460] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11794.936893] Lustre: server umount lustre-MDT0001 complete [11810.754339] Lustre: server umount lustre-OST0000 complete [11811.824352] Lustre: 333422:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229282/real 1782229282] req@ffff934947ade300 x1868802583286400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782229298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [11811.859470] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11815.462988] Lustre: server umount lustre-OST0001 complete [11819.681908] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [11821.400595] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [11823.389769] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 11:41:49 (1782229309) [11848.743116] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [11857.953791] loop0: detected capacity change from 0 to 1099511627776 [11858.489510] SGI XFS with ACLs, security attributes, quota, no debug enabled [11858.499740] *** VALIDATE xfs *** [11858.513461] XFS (loop0): Mounting V5 Filesystem [11858.540237] XFS (loop0): Ending clean mount [11859.840305] loop1: detected capacity change from 0 to 18691697672192 [11967.071140] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [11977.691490] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [12018.499747] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12018.660513] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12018.684463] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12018.756222] Lustre: lustre-MDT0000: new disk, initializing [12018.824254] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12018.844881] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12023.478223] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12034.603608] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12034.789961] Lustre: 347572:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12034.846602] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12034.855480] Lustre: Skipped 1 previous similar message [12034.988911] Lustre: lustre-MDT0001: new disk, initializing [12035.184263] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12035.195655] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12040.437281] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12050.724799] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12056.655754] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12064.126870] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12064.418700] Lustre: lustre-OST0000: new disk, initializing [12064.422260] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12064.430041] Lustre: 349540:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [12065.608919] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12065.620248] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12065.748773] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12071.255421] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12080.907581] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12085.659716] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [12085.847569] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [12090.192354] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [12090.395287] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [12096.485197] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12096.486124] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [12096.489920] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12096.489929] Lustre: Skipped 1 previous similar message [12096.502611] Lustre: Skipped 1 previous similar message [12096.542637] LustreError: Skipped 1 previous similar message [12101.604352] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12101.618198] Lustre: Skipped 2 previous similar messages [12107.232262] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [12107.353465] Lustre: server umount lustre-OST0000 complete [12111.841576] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12111.842567] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12111.873946] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12111.883830] Lustre: Skipped 3 previous similar messages [12125.152131] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [12125.352260] Lustre: server umount lustre-MDT0000 complete [12127.205667] LustreError: 347583:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12127.225915] LustreError: 347583:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12128.813427] LustreError: 347563:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229615 with bad export cookie 11027965262370689158 [12128.818920] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12128.826384] LustreError: 347563:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [12129.180440] Lustre: server umount lustre-MDT0001 complete [12136.688343] XFS (loop0): Unmounting Filesystem [12141.240688] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 11:47:07 (1782229627) [12148.269638] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12148.786992] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12148.790495] Lustre: Skipped 2 previous similar messages [12153.140240] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12161.496989] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12166.699856] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12173.469922] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12179.105635] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12187.104151] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12194.457035] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12203.075900] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12217.315748] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12217.317239] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [12217.320053] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12217.320063] Lustre: Skipped 4 previous similar messages [12217.339200] Lustre: Skipped 2 previous similar messages [12221.017237] Lustre: server umount lustre-OST0000 complete [12239.328370] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [12239.614654] Lustre: server umount lustre-MDT0000 complete [12243.638073] LustreError: 354980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229730 with bad export cookie 11027965262370690033 [12243.645915] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12243.658803] LustreError: 354980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [12244.280994] Lustre: server umount lustre-MDT0001 complete [12257.693244] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [12260.885793] Key type lgssc unregistered [12261.311846] LNet: 355734:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12261.319757] LNetError: 355734:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [12262.377323] LNet: Removed LNI 192.168.203.158@tcp [12263.593657] Key type .llcrypt unregistered [12263.596155] Key type ._llcrypt unregistered [12293.519933] Key type ._llcrypt registered [12293.526320] Key type .llcrypt registered [12293.656410] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [12295.178363] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12295.283713] alg: No test for adler32 (adler32-zlib) [12296.487828] Lustre: Lustre: Build Version: 2.17.54_83_g7183f09 [12296.755317] LNet: Added LNI 192.168.203.158@tcp [8/256/0/180] [12298.464243] Key type lgssc registered [12300.171468] Lustre: Echo OBD driver; http://www.lustre.org/ [12308.439172] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [12308.476076] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12309.823532] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12314.469729] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12319.211618] LustreError: 357304:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12319.245614] LustreError: 357304:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12324.335303] LustreError: 357303:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12324.637105] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12325.318776] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12330.470392] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12338.324084] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12345.182578] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12353.104656] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12353.435544] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12359.914745] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12368.127459] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12380.057942] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.58@tcp (stopping) [12381.155831] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12381.180603] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12381.193032] Lustre: Skipped 1 previous similar message [12384.708608] Lustre: server umount lustre-MDT0001 complete [12385.137981] LustreError: 359795:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12390.252548] LustreError: 358466:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12390.273144] LustreError: 358466:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12395.377260] LustreError: 357300:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12395.419789] LustreError: 357300:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12396.707554] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12396.819568] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12396.829343] Lustre: Found index 1 for lustre-MDT0001, updating log [12396.904457] Lustre: 357292:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12397.312544] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12402.211187] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12402.671753] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12403.709220] LustreError: 360826:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12403.719408] LustreError: 360826:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12403.729522] LustreError: 357295:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12403.792134] LustreError: 360830:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.158@tcp: cfg command failed: rc = -17 [12403.799605] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [12403.799605] [12412.904158] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12412.908669] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12412.923441] Lustre: Skipped 1 previous similar message [12412.927276] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12412.953303] Lustre: Skipped 1 previous similar message [12415.882877] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.58@tcp (stopping) [12418.022094] LustreError: 357304:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12418.040637] LustreError: 357304:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [12418.100971] Lustre: server umount lustre-MDT0001 complete [12429.707122] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12429.794239] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12429.803293] Lustre: Found index 1 for lustre-MDT0001, updating log [12429.847510] Lustre: 357291:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12430.256934] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12435.456635] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12435.582877] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12438.041913] LustreError: 361945:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12438.051996] LustreError: 361945:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12438.074240] LustreError: 357295:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12438.086587] LustreError: 357295:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12438.146993] LustreError: 361952:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [12438.153599] LustreError: 361952:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [12438.163587] LustreError: 361952:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.158@tcp: cfg command failed: rc = -17 [12438.171756] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.158@tcp [12438.171756] [12742.628913] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12742.632910] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12742.657037] Lustre: Skipped 1 previous similar message [12742.660764] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12748.349732] Lustre: server umount lustre-MDT0001 complete [12748.662791] LustreError: 359795:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12748.690991] LustreError: 359795:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [12759.405640] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12759.469572] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12759.473166] Lustre: Found index 1 for lustre-MDT0001, updating log [12759.515519] Lustre: 357293:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12759.789061] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12764.054189] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [12765.168510] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12765.180924] LustreError: 370616:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12765.187984] LustreError: 370616:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12765.197522] LustreError: 357295:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12765.201550] LustreError: 357295:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12765.307073] LustreError: 370622:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12765.323696] LustreError: 370622:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.158@tcp: cfg command failed: rc = -114 [12765.331032] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12765.331032] [13087.721544] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [13087.725177] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13087.731047] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13087.731055] Lustre: Skipped 4 previous similar messages [13087.767388] Lustre: Skipped 3 previous similar messages [13093.523487] Lustre: server umount lustre-MDT0000 complete [13097.956029] LustreError: 372033:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13097.995249] LustreError: 372033:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [13098.037669] LustreError: 357283:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782230585 with bad export cookie 12582154657266288433 [13098.055672] LustreError: 357283:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [13098.069067] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13103.088138] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13104.654417] Lustre: server umount lustre-MDT0001 complete [13109.605894] Lustre: server umount lustre-OST0000 complete [13121.766635] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [13133.644738] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [13176.361283] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 12:04:22 (1782230662) [13184.058667] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13184.357317] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [13184.387873] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [13184.481298] Lustre: lustre-MDT0000: new disk, initializing [13184.589892] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [13184.612773] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [13190.255535] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [13202.179415] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13202.331344] Lustre: 381206:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [13202.412766] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [13202.417025] Lustre: Skipped 1 previous similar message [13202.523274] Lustre: lustre-MDT0001: new disk, initializing [13202.650191] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [13202.717120] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [13202.730778] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [13207.912660] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [13219.137551] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [13225.383668] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [13232.538793] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [13233.024745] Lustre: lustre-OST0000: new disk, initializing [13233.031807] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [13233.051303] Lustre: 383174:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [13233.194961] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [13240.901712] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug -1 all [13242.472740] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [13242.492575] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [13242.660533] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [13252.225646] Lustre: DEBUG MARKER: oleg358-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13261.723841] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [13261.735769] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13261.761757] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13261.779873] Lustre: Skipped 6 previous similar messages [13262.050347] Lustre: server umount lustre-MDT0000 complete [13263.336423] LustreError: 381217:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13263.384080] LustreError: 381217:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [13267.393268] LustreError: 381198:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782230754 with bad export cookie 12582154657266290386 [13267.400286] LustreError: 382013:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [13267.402569] LustreError: MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13267.411505] LustreError: 381198:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [13268.044485] Lustre: server umount lustre-MDT0001 complete [13283.655415] Lustre: server umount lustre-OST0000 complete [13315.052374] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing set_hostid [13326.354345] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local [13362.000795] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 13122 sec ========= 12:07:27 (1782230847) [13363.832143] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 12:07:30 (1782230850) === [13368.011305] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 12:07:33 (1782230853) === [13411.260746] Lustre: DEBUG MARKER: oleg358-server.virtnet: executing unload_modules_local [13414.677439] Key type lgssc unregistered [13414.946890] LNet: 389544:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13414.954883] LNetError: 389544:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [13414.975826] LNet: Removed LNI 192.168.203.158@tcp [13416.068119] Key type .llcrypt unregistered [13416.071986] Key type ._llcrypt unregistered